Jul 05 03:27:54.017154 np0000004562 systemd[1]: Started devstack@c-bak.service - Devstack devstack@c-bak.service. Jul 05 03:27:54.186136 np0000004562 cinder-backup[101413]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 05 03:27:54.186136 np0000004562 cinder-backup[101413]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 03:27:54.186136 np0000004562 cinder-backup[101413]: we strongly recommend against using it for new projects. Jul 05 03:27:54.186136 np0000004562 cinder-backup[101413]: If you are already using Eventlet, we recommend migrating to a different Jul 05 03:27:54.186136 np0000004562 cinder-backup[101413]: framework. For more detail see Jul 05 03:27:54.186136 np0000004562 cinder-backup[101413]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 03:27:54.186136 np0000004562 cinder-backup[101413]: import eventlet # noqa Jul 05 03:27:55.212399 np0000004562 cinder-backup[101413]: INFO cinder.cmd.backup [-] Backup running in single process mode. Jul 05 03:27:55.324954 np0000004562 cinder-backup[101413]: INFO dbcounter [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] Registered counter for database cinder Jul 05 03:27:55.362381 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:27:55.453283 np0000004562 cinder-backup[101413]: DEBUG dbcounter [-] [101413] Writer thread running {{(pid=101413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 05 03:27:55.456507 np0000004562 cinder-backup[101413]: INFO cinder.rpc [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] Automatically selected cinder-backup objects version 1.39 as minimum service version. Jul 05 03:27:55.458561 np0000004562 cinder-backup[101413]: INFO cinder.rpc [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] Automatically selected cinder-backup RPC version 2.4 as minimum service version. Jul 05 03:27:55.460269 np0000004562 cinder-backup[101413]: INFO cinder.rpc [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 05 03:27:55.461837 np0000004562 cinder-backup[101413]: INFO cinder.rpc [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 05 03:27:55.463936 np0000004562 cinder-backup[101413]: INFO cinder.rpc [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 05 03:27:55.465601 np0000004562 cinder-backup[101413]: INFO cinder.rpc [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 05 03:27:55.512614 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:27:55.524204 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.lockutils [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] Acquiring lock "singleton_lock" {{(pid=101413) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 03:27:55.524314 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.lockutils [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] Acquired lock "singleton_lock" {{(pid=101413) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 03:27:55.524526 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.lockutils [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] Releasing lock "singleton_lock" {{(pid=101413) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 03:27:55.524701 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] ******************************************************************************** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 05 03:27:55.524817 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] Configuration options gathered from: {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 05 03:27:55.524938 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 05 03:27:55.525069 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 05 03:27:55.525175 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] ================================================================================ {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 05 03:27:55.525341 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] allow_availability_zone_fallback = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.525469 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] allow_compression_on_image_upload = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.525594 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] allowed_direct_url_schemes = [] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.525696 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] api_rate_limit = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.525832 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] auth_strategy = keystone {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.525942 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backdoor_port = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.526031 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backdoor_socket = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.526157 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_availability_zone = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.526274 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_api_class = cinder.backup.api.API {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.526412 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_compression_algorithm = zlib {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.526524 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_create_containers = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.526636 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_driver = cinder.backup.drivers.swift.SwiftBackupDriver {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.526757 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_driver_init_check_interval = 60 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.526890 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_driver_stats_polling_interval = 60 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.527015 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.527126 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_max_operations = 15 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.527243 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_metadata_version = 2 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.527360 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_name_template = backup-%s {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.527480 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_native_threads_pool_size = 60 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.527584 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_object_number_per_notification = 10 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.527683 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_service_inithost_offload = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.527825 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_auth = per_user {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.527953 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_auth_insecure = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.528066 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_auth_url = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.528190 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_auth_version = 1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.528291 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_block_size = 32768 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.528415 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_ca_cert_file = /opt/stack/data/ca-bundle.pem {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.528532 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_container = volumebackups {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.529728 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_create_storage_policy = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.529728 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_enable_progress_timer = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.529728 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_key = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.529728 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_object_size = 52428800 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.529728 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_project = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.529728 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_project_domain = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.529728 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_region_name = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.530013 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_retry_attempts = 3 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.530013 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_retry_backoff = 2 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.530013 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_service_auth = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.530013 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_tenant = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.530171 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_url = https://10.4.3.249:8080/v1/AUTH_ {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.530281 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_user = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.530367 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_user_domain = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.530484 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_timer_interval = 120 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.530585 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_use_same_host = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.530692 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_use_temp_snapshot = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.530815 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_workers = 1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.530926 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] chap_password = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.531031 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] chap_username = {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.531158 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.531312 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cinder_internal_tenant_project_id = 7cbf7502a6d94509bb6d893e0da08b5c {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.531494 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cinder_internal_tenant_user_id = b95b599f711d41c69a4c8aafa911ed04 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.531669 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] compression_format = gzip {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.531873 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] config_dir = [] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.534503 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.534503 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] config_source = [] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.534503 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.534503 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] control_exchange = openstack {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.534503 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] debug = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.534503 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] default_availability_zone = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.534503 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] default_group_type = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.535459 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'swiftclient=WARN', 'botocore=WARN'] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.535459 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] default_volume_type = storpool {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.535459 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] disk_geometry = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.535459 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] driver_client_cert = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.535459 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] driver_client_cert_key = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.535941 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] driver_data_namespace = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.535941 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] driver_ssl_cert_path = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.535941 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] driver_ssl_cert_verify = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.535941 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] driver_use_ssl = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.535941 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] enable_new_services = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.535941 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] enable_unsupported_driver = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.535941 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] enabled_backends = ['storpool'] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.536176 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] enforce_multipath_for_image_xfer = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.536176 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] filter_function = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.536176 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance_api_insecure = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.536176 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance_api_servers = ['https://10.4.3.249/image'] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.536176 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance_api_ssl_compression = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.536176 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance_ca_certificates_file = /opt/stack/data/ca-bundle.pem {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.536176 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance_catalog_info = image:glance:publicURL {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.536442 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance_certfile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.536442 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.536442 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance_keyfile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.536442 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance_num_retries = 3 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.536442 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance_request_timeout = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.536442 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] goodness_function = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.536442 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] graceful_shutdown_timeout = 5 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.536682 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] group_api_class = cinder.group.api.API {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.536682 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] host = np0000004562 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.536682 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] image_compress_on_upload = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.536913 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] image_conversion_address_space_limit = 1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.537038 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] image_conversion_cpu_limit = 60 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.537255 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.537381 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] image_conversion_disable = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.537554 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] image_upload_use_cinder_backend = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.537752 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] image_upload_use_internal_tenant = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.537906 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] image_volume_cache_enabled = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.538069 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] image_volume_cache_max_count = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.538228 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] image_volume_cache_max_size_gb = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.538403 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] instance_format = [instance: %(uuid)s] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.538539 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.538649 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] iscsi_target_flags = {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.538780 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] iscsi_write_cache = on {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.538892 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] iser_helper = tgtadm {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.539051 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] iser_ip_address = 10.4.3.249 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.539202 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] iser_port = 3260 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.539387 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.539560 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_catalog_info = identity:Identity Service:publicURL {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.539770 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] log_color = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.539949 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] log_config_append = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.540126 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.540295 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] log_dir = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.540435 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] log_file = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.540556 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] log_options = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.540670 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] log_rotate_interval = 1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.540812 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] log_rotate_interval_type = days {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.540940 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] log_rotation_type = none {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.541035 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.541128 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.541250 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.541376 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.541469 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.541591 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] max_age = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.541703 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] max_logfile_count = 30 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.542173 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] max_logfile_size_mb = 200 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.542173 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] max_over_subscription_ratio = 20.0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.542173 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] message_reap_interval = 86400 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.542173 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] message_ttl = 2592000 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.542365 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] monkey_patch = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.542408 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] monkey_patch_modules = [] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.542490 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] my_ip = 10.4.3.249 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.542591 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] no_snapshot_gb_quota = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.542688 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] num_iser_scan_tries = 3 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.542819 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] num_shell_tries = 3 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.542992 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] num_volume_device_scan_tries = 3 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.543155 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] nvmeof_conn_info_version = 1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.543330 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] nvmet_ns_id = 10 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.543504 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] nvmet_port_id = 1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.543674 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] osapi_max_limit = 1000 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.543855 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] osapi_volume_ext_list = [] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.544040 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.544214 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.544388 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] osapi_volume_listen_port = 8776 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.544553 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] osapi_volume_use_ssl = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.544724 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] osapi_volume_workers = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.544893 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] per_volume_size_limit = -1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.545053 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] periodic_fuzzy_delay = 60 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.545210 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] periodic_interval = 60 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.545397 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.545556 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] public_endpoint = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.545726 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] publish_errors = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.545879 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] quota_backup_gigabytes = 1000 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.545999 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] quota_backups = 10 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.546109 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.546212 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] quota_gigabytes = 1000 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.546314 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] quota_groups = 10 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.546439 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] quota_snapshots = 10 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.546546 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] quota_volumes = 10 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.546646 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] rate_limit_burst = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.546776 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] rate_limit_except_level = CRITICAL {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.546878 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] rate_limit_interval = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.546983 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] replication_device = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.547084 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] report_discard_supported = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.547190 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] report_interval = 120 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.547373 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] reservation_clean_interval = 86400 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.547462 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] reservation_expire = 86400 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.547570 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] reserved_image_namespaces = [] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.547675 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] reserved_percentage = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.547827 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.547936 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.548048 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] rpc_response_timeout = 120 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.548152 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] run_external_periodic_tasks = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.548256 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.548369 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] scst_target_driver = iscsi {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.548468 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] scst_target_iqn_name = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.548572 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] service_down_time = 720 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.548673 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] shell_completion = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.548813 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] snapshot_name_template = snapshot-%s {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.548915 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] split_loggers = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.548999 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] state_path = /opt/stack/data/cinder {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.549105 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] storage_availability_zone = nova {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.549212 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] storage_protocol = iSCSI {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.549314 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] swift_catalog_info = object-store:swift:publicURL {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.549434 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] syslog_log_facility = LOG_USER {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.549541 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] target_helper = lioadm {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.549697 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] target_ip_address = 10.4.3.249 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.549842 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] target_port = 3260 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.549961 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.550082 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] target_protocol = iscsi {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.550196 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] target_secondary_ip_addresses = [] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.550314 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] trace_flags = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.550497 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.550670 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] transport_url = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.550857 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] until_refresh = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.551029 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] use_chap_auth = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.551190 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] use_default_quota_class = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.551356 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] use_journal = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.551518 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] use_json = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.551682 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] use_multipath_for_image_xfer = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.551868 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] use_stderr = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.552033 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] use_syslog = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.552200 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] verify_glance_signatures = enabled {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.552384 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.552556 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] volume_api_class = cinder.volume.api.API {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.552728 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] volume_backend_name = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.552913 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] volume_clear = zero {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.553073 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] volume_clear_ionice = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.553237 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] volume_clear_size = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.553399 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.553536 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] volume_copy_bps_limit = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.553646 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] volume_dd_blocksize = 1M {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.553776 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.553885 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] volume_name_template = volume-%s {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.554003 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] volume_usage_audit_period = month {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.554165 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.554259 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_concurrency.disable_process_locking = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.554382 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.554567 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.554690 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.554818 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.555020 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.555020 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.555115 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.555930 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.555930 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.555930 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.auth_section = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.555930 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.auth_type = password {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.555930 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.auth_version = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.555930 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.cache = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.555930 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.556301 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.certfile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.556301 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.556301 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.556301 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.556470 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.556513 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.include_service_catalog = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.556624 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.insecure = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.556766 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.interface = public {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.556873 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.keyfile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.556977 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcache_password = {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.557077 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.557197 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.557301 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.557417 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.557534 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.557638 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.557765 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.557882 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.557979 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.558076 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.558194 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.558295 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.558404 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.558507 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.558627 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcache_username = {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.558772 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.558880 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.region_name = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.558990 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.559090 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.559204 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.service_type = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.559340 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.559468 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.www_authenticate_uri = https://10.4.3.249/identity {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.559637 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.backend = dogpile.cache.null {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.559809 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.backend_argument = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.559938 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.backend_expiration_time = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.560099 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.config_prefix = cache.oslo {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.560256 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.debug_cache_backend = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.560420 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.enable_retry_client = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.560576 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.enable_socket_keepalive = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.560743 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.enabled = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.560895 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.expiration_time = 600 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.561031 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.561137 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.hashclient_retry_attempts = 2 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.561242 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.561352 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.memcache_dead_retry = 300 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.561473 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.561585 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.561684 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.memcache_pool_maxsize = 10 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.561814 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.561918 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.memcache_sasl_enabled = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.562031 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.562193 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.password = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.562361 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.proxies = [] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.562509 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.redis_db = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.562640 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.562790 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.562927 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.redis_server = localhost:6379 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.563063 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.retry_attempts = 2 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.563226 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.retry_delay = 0.0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.563357 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.socket_keepalive_count = 1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.563515 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.socket_keepalive_idle = 1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.563665 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.socket_keepalive_interval = 1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.563851 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.socket_timeout = 1.0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.564003 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.tls_allowed_ciphers = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.564157 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.tls_cafile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.564296 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.tls_certfile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.564443 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.tls_enabled = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.564545 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.tls_keyfile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.564649 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.username = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.564791 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] coordination.backend_url = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.564924 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.asyncio_connection = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.565028 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.asyncio_slave_connection = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.565136 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.backend = sqlalchemy {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.565242 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.connection = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.565406 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.connection_debug = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.565566 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.connection_parameters = {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.565735 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.connection_recycle_time = 3600 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.565875 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.connection_trace = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.565999 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.db_inc_retry_interval = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.566124 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.db_max_retries = 20 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.566259 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.db_max_retry_interval = 10 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.566420 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.db_retry_interval = 1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.566557 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.max_overflow = 50 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.566687 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.max_pool_size = 5 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.566861 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.max_retries = 10 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.567022 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.567167 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.mysql_wsrep_sync_wait = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.567319 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.pool_timeout = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.567489 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.retry_interval = 10 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.567628 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.slave_connection = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.567797 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.sqlite_synchronous = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.567907 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.synchronous_reader = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.568010 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.use_db_reconnect = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.568139 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.568244 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.568366 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.568505 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.568618 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.568753 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] profiler.connection_string = messaging:// {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.568868 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] profiler.enabled = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.569000 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] profiler.es_doc_type = notification {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.569104 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] profiler.es_scroll_size = 10000 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.569210 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] profiler.es_scroll_time = 2m {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.569310 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] profiler.filter_error_trace = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.569435 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] profiler.hmac_keys = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.569567 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] profiler.sentinel_service_name = mymaster {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.569684 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] profiler.socket_timeout = 0.1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.569815 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] profiler.trace_requests = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.569942 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] profiler.trace_sqlalchemy = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.570064 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] profiler_jaeger.process_tags = {} {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.570164 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] profiler_jaeger.service_name_prefix = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.570265 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] profiler_otlp.service_name_prefix = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.570395 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_policy.enforce_new_defaults = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.570499 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_policy.enforce_scope = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.570604 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_policy.policy_default_rule = default {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.570724 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.570858 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_policy.policy_file = policy.yaml {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.570993 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.571095 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.571191 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.571289 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.571400 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.571537 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.571648 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.571791 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] privsep_osbrick.group = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.572195 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] privsep_osbrick.helper_command = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.572195 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.572195 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.572195 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] privsep_osbrick.thread_pool_size = 16 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.572405 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] privsep_osbrick.user = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.572405 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.572521 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cinder_sys_admin.group = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.572618 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cinder_sys_admin.helper_command = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.572726 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.572849 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.572971 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cinder_sys_admin.thread_pool_size = 16 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.573074 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cinder_sys_admin.user = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.573177 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] service_user.auth_section = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.573286 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] service_user.auth_type = password {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.573397 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] service_user.cafile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.573529 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] service_user.certfile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.573640 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] service_user.collect_timing = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.573766 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] service_user.insecure = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.573874 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] service_user.keyfile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.574000 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] service_user.send_service_user_token = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.574137 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] service_user.split_loggers = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.574246 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] service_user.timeout = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.574375 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance.auth_section = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.574794 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance.auth_type = password {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.574794 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.574794 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance.certfile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.574794 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance.collect_timing = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.574950 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance.insecure = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.575034 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance.keyfile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.575133 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance.region_name = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.575233 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance.split_loggers = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.575338 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance.timeout = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.575489 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.backend_availability_zone = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.575603 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.chap_password = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.575706 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.chap_username = {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.575866 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.575992 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.disk_geometry = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.576120 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.driver_client_cert = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.576228 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.driver_client_cert_key = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.576341 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.driver_data_namespace = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.576457 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.576577 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.576682 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.driver_use_ssl = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.576814 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.576939 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.577044 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.filter_function = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.577144 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.goodness_function = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.577253 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.577424 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.577571 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.577678 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.577812 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.577944 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.iscsi_target_flags = {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.578060 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.iscsi_write_cache = on {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.578192 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.iser_helper = tgtadm {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.578373 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.iser_ip_address = 10.4.3.249 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.578496 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.iser_port = 3260 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.578621 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.578753 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.578863 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.578988 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.num_shell_tries = 3 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.579091 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.579190 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.579288 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.579398 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.579516 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.replication_device = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.579632 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.report_discard_supported = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.579757 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.reserved_percentage = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.579907 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.580025 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.580161 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.580276 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.target_helper = tgtadm {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.580490 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.target_ip_address = 10.4.3.249 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.580624 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.target_port = 3260 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.580760 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.580928 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.target_protocol = iscsi {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.581053 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.581159 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.trace_flags = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.581266 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.unique_fqdn_network = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.581382 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.use_chap_auth = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.581521 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.581648 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.volume_backend_name = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.581790 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.volume_clear = zero {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.581934 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.volume_clear_ionice = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.582044 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.volume_clear_size = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.582185 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.582289 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.582406 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.582545 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.582669 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_reports.file_event_handler = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.582821 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.582987 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_reports.log_dir = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.583156 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.583343 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.583522 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.583690 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.583893 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.584043 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.584181 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.584291 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.584414 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.hostname = np0000004562 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.584517 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.584629 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.584762 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.584890 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.585004 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.585142 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.processname = cinder-backup {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.585257 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.585379 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.585516 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.585624 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.585758 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.585863 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.585980 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.586128 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.586241 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.586353 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.586452 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.586551 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.586653 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.586796 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.586903 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.ssl = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.587030 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.587136 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.587237 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.587345 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.587479 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.587594 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.587730 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.587864 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_notifications.driver = [] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.587987 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_notifications.retry = -1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.588132 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.588242 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.588370 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.588577 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.588690 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.barbican_api_version = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.588845 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.barbican_endpoint = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.588971 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.barbican_endpoint_type = public {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.589082 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.barbican_region_name = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.589230 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.cafile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.589386 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.certfile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.589538 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.collect_timing = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.589689 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.insecure = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.589860 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.keyfile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.590018 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.number_of_retries = 60 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.590149 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.retry_delay = 1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.590272 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.send_service_user_token = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.590418 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.split_loggers = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.590550 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.timeout = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.590652 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.verify_ssl = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.590781 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.verify_ssl_path = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.590888 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican_service_user.auth_section = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.590991 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican_service_user.auth_type = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.591088 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican_service_user.cafile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.591206 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican_service_user.certfile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.591312 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican_service_user.collect_timing = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.591453 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican_service_user.insecure = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.591557 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican_service_user.keyfile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.591657 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican_service_user.split_loggers = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.591781 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican_service_user.timeout = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.591891 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] vault.approle_role_id = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.592034 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] vault.approle_secret_id = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.592195 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] vault.kv_mountpoint = secret {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.592361 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] vault.kv_path = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.592502 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] vault.kv_version = 2 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.592624 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] vault.namespace = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.592761 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] vault.root_token_id = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.592895 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] vault.ssl_ca_crt_file = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.593037 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] vault.timeout = 60.0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.593143 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] vault.use_ssl = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.593343 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.593429 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] ******************************************************************************** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 05 03:27:55.593591 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] Full set of CONF: {{(pid=101413) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:275}} Jul 05 03:27:55.593668 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] ******************************************************************************** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 05 03:27:55.593775 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] Configuration options gathered from: {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 05 03:27:55.593865 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 05 03:27:55.593945 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 05 03:27:55.594010 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] ================================================================================ {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 05 03:27:55.594129 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] allow_availability_zone_fallback = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.594204 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] allow_compression_on_image_upload = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.594278 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] allowed_direct_url_schemes = [] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.594360 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] api_rate_limit = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.594436 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] auth_strategy = keystone {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.594509 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backdoor_port = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.594581 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backdoor_socket = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.594652 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_availability_zone = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.594748 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_api_class = cinder.backup.api.API {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.594836 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_compression_algorithm = zlib {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.594911 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_create_containers = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.594982 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_driver = cinder.backup.drivers.swift.SwiftBackupDriver {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.595054 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_driver_init_check_interval = 60 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.595127 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_driver_stats_polling_interval = 60 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.595198 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.595263 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_max_operations = 15 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.595346 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_metadata_version = 2 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.595423 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_name_template = backup-%s {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.595495 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_native_threads_pool_size = 60 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.595566 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_object_number_per_notification = 10 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.595637 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_service_inithost_offload = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.595723 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_auth = per_user {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.595818 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_auth_insecure = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.595894 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_auth_url = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.595967 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_auth_version = 1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.596043 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_block_size = 32768 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.596117 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_ca_cert_file = /opt/stack/data/ca-bundle.pem {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.596191 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_container = volumebackups {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.596261 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_create_storage_policy = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.596343 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_enable_progress_timer = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.596410 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_key = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.596486 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_object_size = 52428800 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.596555 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_project = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.596625 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_project_domain = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.596697 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_region_name = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.596801 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_retry_attempts = 3 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.596873 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_retry_backoff = 2 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.596947 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_service_auth = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.597019 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_tenant = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.597089 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_url = https://10.4.3.249:8080/v1/AUTH_ {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.597162 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_user = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.597233 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_swift_user_domain = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.597305 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_timer_interval = 120 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.597393 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_use_same_host = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.597453 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_use_temp_snapshot = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.597533 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backup_workers = 1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.597602 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] chap_password = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.597772 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] chap_username = {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.597871 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.597947 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cinder_internal_tenant_project_id = 7cbf7502a6d94509bb6d893e0da08b5c {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.598021 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cinder_internal_tenant_user_id = b95b599f711d41c69a4c8aafa911ed04 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.598101 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] compression_format = gzip {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.598164 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] config_dir = [] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.598234 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.598307 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] config_source = [] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.598390 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.598464 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] control_exchange = openstack {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.598535 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] debug = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.598607 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] default_availability_zone = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.598679 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] default_group_type = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.598854 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'swiftclient=WARN', 'botocore=WARN'] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.598950 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] default_volume_type = storpool {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.599028 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] disk_geometry = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.599099 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] driver_client_cert = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.599168 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] driver_client_cert_key = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.599240 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] driver_data_namespace = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.599311 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] driver_ssl_cert_path = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.599394 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] driver_ssl_cert_verify = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.599466 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] driver_use_ssl = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.599579 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] enable_new_services = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.599651 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] enable_unsupported_driver = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.599744 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] enabled_backends = ['storpool'] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.599837 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] enforce_multipath_for_image_xfer = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.599939 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] filter_function = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.600018 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance_api_insecure = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.600112 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance_api_servers = ['https://10.4.3.249/image'] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.600241 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance_api_ssl_compression = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.600241 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance_ca_certificates_file = /opt/stack/data/ca-bundle.pem {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.600341 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance_catalog_info = image:glance:publicURL {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.600388 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance_certfile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.600469 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.600569 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance_keyfile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.600646 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance_num_retries = 3 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.600724 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance_request_timeout = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.600828 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] goodness_function = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.600923 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] graceful_shutdown_timeout = 5 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.601009 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] group_api_class = cinder.group.api.API {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.601097 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] host = np0000004562 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.601177 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] image_compress_on_upload = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.601250 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] image_conversion_address_space_limit = 1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.601333 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] image_conversion_cpu_limit = 60 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.601409 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.601473 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] image_conversion_disable = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.601545 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] image_upload_use_cinder_backend = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.601613 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] image_upload_use_internal_tenant = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.601684 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] image_volume_cache_enabled = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.601788 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] image_volume_cache_max_count = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.601867 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] image_volume_cache_max_size_gb = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.601965 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] instance_format = [instance: %(uuid)s] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.602027 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.602130 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] iscsi_target_flags = {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.602201 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] iscsi_write_cache = on {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.602270 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] iser_helper = tgtadm {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.602344 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] iser_ip_address = 10.4.3.249 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.602419 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] iser_port = 3260 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.602490 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.602560 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_catalog_info = identity:Identity Service:publicURL {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.602628 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] log_color = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.602696 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] log_config_append = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.602799 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.602876 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] log_dir = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.602969 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] log_file = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.603042 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] log_options = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.603127 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] log_rotate_interval = 1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.603206 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] log_rotate_interval_type = days {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.603270 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] log_rotation_type = none {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.603356 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.603428 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.603501 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.603567 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.603639 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.603726 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] max_age = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.603809 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] max_logfile_count = 30 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.603886 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] max_logfile_size_mb = 200 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.603979 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] max_over_subscription_ratio = 20.0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.604053 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] message_reap_interval = 86400 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.604137 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] message_ttl = 2592000 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.604215 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] monkey_patch = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.604285 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] monkey_patch_modules = [] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.604368 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] my_ip = 10.4.3.249 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.604439 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] no_snapshot_gb_quota = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.604506 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] num_iser_scan_tries = 3 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.604575 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] num_shell_tries = 3 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.604628 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] num_volume_device_scan_tries = 3 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.604728 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] nvmeof_conn_info_version = 1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.604847 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] nvmet_ns_id = 10 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.604892 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] nvmet_port_id = 1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.604983 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] osapi_max_limit = 1000 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.605039 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] osapi_volume_ext_list = [] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.605119 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.605211 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.605285 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] osapi_volume_listen_port = 8776 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.605370 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] osapi_volume_use_ssl = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.605428 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] osapi_volume_workers = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.605506 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] per_volume_size_limit = -1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.605560 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] periodic_fuzzy_delay = 60 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.605639 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] periodic_interval = 60 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.605706 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.605809 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] public_endpoint = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.605890 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] publish_errors = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.605979 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] quota_backup_gigabytes = 1000 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.606053 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] quota_backups = 10 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.606124 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.606218 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] quota_gigabytes = 1000 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.606268 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] quota_groups = 10 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.606358 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] quota_snapshots = 10 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.606429 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] quota_volumes = 10 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.606499 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] rate_limit_burst = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.606570 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] rate_limit_except_level = CRITICAL {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.606639 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] rate_limit_interval = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.606722 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] replication_device = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.606814 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] report_discard_supported = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.606896 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] report_interval = 120 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.606985 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] reservation_clean_interval = 86400 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.607055 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] reservation_expire = 86400 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.607127 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] reserved_image_namespaces = [] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.607212 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] reserved_percentage = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.607285 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.607367 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.607425 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] rpc_response_timeout = 120 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.607504 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] run_external_periodic_tasks = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.607558 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.607639 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] scst_target_driver = iscsi {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.607704 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] scst_target_iqn_name = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.607806 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] service_down_time = 720 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.607878 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] shell_completion = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.607976 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] snapshot_name_template = snapshot-%s {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.608047 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] split_loggers = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.608116 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] state_path = /opt/stack/data/cinder {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.608195 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] storage_availability_zone = nova {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.608273 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] storage_protocol = iSCSI {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.608356 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] swift_catalog_info = object-store:swift:publicURL {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.608426 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] syslog_log_facility = LOG_USER {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.608502 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] target_helper = lioadm {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.608564 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] target_ip_address = 10.4.3.249 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.608629 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] target_port = 3260 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.608700 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.608807 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] target_protocol = iscsi {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.608882 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] target_secondary_ip_addresses = [] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.608980 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] trace_flags = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.609053 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.609123 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] transport_url = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.609195 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] until_refresh = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.609283 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] use_chap_auth = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.609370 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] use_default_quota_class = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.609460 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] use_journal = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.609588 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] use_json = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.609673 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] use_multipath_for_image_xfer = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.609783 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] use_stderr = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.609865 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] use_syslog = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.609966 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] verify_glance_signatures = enabled {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.610044 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.610117 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] volume_api_class = cinder.volume.api.API {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.610208 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] volume_backend_name = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.610274 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] volume_clear = zero {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.610363 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] volume_clear_ionice = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.610433 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] volume_clear_size = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.610504 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.610573 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] volume_copy_bps_limit = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.610636 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] volume_dd_blocksize = 1M {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.610699 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.610812 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] volume_name_template = volume-%s {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.610894 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] volume_usage_audit_period = month {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.610988 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 03:27:55.611075 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_concurrency.disable_process_locking = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.611148 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.611239 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.611332 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.611408 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.611480 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.611554 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.611634 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.611706 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.611819 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.611922 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.auth_section = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.612003 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.auth_type = password {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.612079 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.auth_version = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.612152 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.cache = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.612223 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.612310 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.certfile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.612380 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.612462 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.612533 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.612604 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.612672 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.include_service_catalog = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.612774 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.insecure = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.612858 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.interface = public {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.612952 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.keyfile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.613017 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcache_password = {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.613096 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.613168 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.613237 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.613332 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.613411 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.613480 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.613552 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.613608 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.613689 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.613773 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.613865 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.613961 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.614040 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.614115 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.614185 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcache_username = {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.614257 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.614357 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.region_name = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.614430 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.614508 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.614575 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.service_type = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.614642 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.614697 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] keystone_authtoken.www_authenticate_uri = https://10.4.3.249/identity {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.614826 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.backend = dogpile.cache.null {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.614925 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.backend_argument = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.615009 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.backend_expiration_time = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.615075 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.config_prefix = cache.oslo {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.615145 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.debug_cache_backend = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.615219 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.enable_retry_client = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.615312 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.enable_socket_keepalive = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.615419 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.enabled = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.615530 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.expiration_time = 600 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.615615 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.615686 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.hashclient_retry_attempts = 2 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.615795 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.615900 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.memcache_dead_retry = 300 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.616016 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.616098 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.616172 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.memcache_pool_maxsize = 10 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.616243 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.616315 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.memcache_sasl_enabled = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.616399 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.616467 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.password = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.616540 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.proxies = [] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.616611 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.redis_db = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.616682 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.616791 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.616890 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.redis_server = localhost:6379 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.616999 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.retry_attempts = 2 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.617132 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.retry_delay = 0.0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.617211 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.socket_keepalive_count = 1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.617290 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.socket_keepalive_idle = 1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.617381 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.socket_keepalive_interval = 1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.617492 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.socket_timeout = 1.0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.617571 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.tls_allowed_ciphers = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.617648 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.tls_cafile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.617726 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.tls_certfile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.617837 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.tls_enabled = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.617946 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.tls_keyfile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.618188 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cache.username = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.618188 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] coordination.backend_url = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.618188 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.asyncio_connection = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.618314 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.asyncio_slave_connection = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.618314 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.backend = sqlalchemy {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.618404 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.connection = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.618456 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.connection_debug = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.618502 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.connection_parameters = {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.618578 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.connection_recycle_time = 3600 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.618644 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.connection_trace = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.618726 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.db_inc_retry_interval = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.618819 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.db_max_retries = 20 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.619038 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.db_max_retry_interval = 10 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.619129 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.db_retry_interval = 1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.619211 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.max_overflow = 50 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.619284 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.max_pool_size = 5 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.619356 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.max_retries = 10 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.619512 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.619579 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.mysql_wsrep_sync_wait = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.619632 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.pool_timeout = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.619674 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.retry_interval = 10 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.619789 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.slave_connection = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.619870 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.sqlite_synchronous = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.619955 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.synchronous_reader = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.620025 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] database.use_db_reconnect = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.620115 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.620218 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.620355 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.620409 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.620461 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.620508 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] profiler.connection_string = messaging:// {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.620589 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] profiler.enabled = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.620663 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] profiler.es_doc_type = notification {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.620763 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] profiler.es_scroll_size = 10000 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.620847 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] profiler.es_scroll_time = 2m {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.620934 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] profiler.filter_error_trace = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.621011 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] profiler.hmac_keys = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.621086 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] profiler.sentinel_service_name = mymaster {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.621161 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] profiler.socket_timeout = 0.1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.621228 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] profiler.trace_requests = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.621301 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] profiler.trace_sqlalchemy = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.621394 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] profiler_jaeger.process_tags = {} {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.621499 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] profiler_jaeger.service_name_prefix = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.621582 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] profiler_otlp.service_name_prefix = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.621658 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_policy.enforce_new_defaults = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.621759 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_policy.enforce_scope = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.621864 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_policy.policy_default_rule = default {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.621980 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.622093 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_policy.policy_file = policy.yaml {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.622207 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.622328 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.622446 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.622560 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.622677 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.622796 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.622920 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.623017 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] privsep_osbrick.group = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.623092 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] privsep_osbrick.helper_command = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.623152 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.623230 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.623301 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] privsep_osbrick.thread_pool_size = 16 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.623385 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] privsep_osbrick.user = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.623495 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.623575 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cinder_sys_admin.group = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.623648 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cinder_sys_admin.helper_command = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.623706 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.623809 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.623877 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cinder_sys_admin.thread_pool_size = 16 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.623947 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] cinder_sys_admin.user = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.624024 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] service_user.auth_section = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.624097 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] service_user.auth_type = password {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.624167 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] service_user.cafile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.624234 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] service_user.certfile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.624306 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] service_user.collect_timing = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.624389 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] service_user.insecure = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.624485 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] service_user.keyfile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.624596 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] service_user.send_service_user_token = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.624693 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] service_user.split_loggers = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.624789 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] service_user.timeout = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.624869 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance.auth_section = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.624949 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance.auth_type = password {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.625031 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.625102 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance.certfile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.625174 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance.collect_timing = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.625243 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance.insecure = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.625311 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance.keyfile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.625406 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance.region_name = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.625510 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance.split_loggers = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.625585 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] glance.timeout = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.625667 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.backend_availability_zone = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.625760 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.chap_password = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.625837 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.chap_username = {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.625908 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.625996 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.disk_geometry = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.626071 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.driver_client_cert = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.626142 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.driver_client_cert_key = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.626212 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.driver_data_namespace = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.626272 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.626358 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.626430 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.driver_use_ssl = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.626501 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.626572 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.626641 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.filter_function = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.626725 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.goodness_function = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.626803 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.626875 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.626947 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.627034 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.627113 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.627218 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.iscsi_target_flags = {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.627356 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.iscsi_write_cache = on {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.627482 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.iser_helper = tgtadm {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.627602 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.iser_ip_address = 10.4.3.249 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.627744 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.iser_port = 3260 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.627884 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.628011 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.628137 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.628252 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.num_shell_tries = 3 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.628372 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.628499 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.628627 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.628775 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.628900 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.replication_device = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.629024 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.report_discard_supported = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.629146 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.reserved_percentage = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.629268 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.629402 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.629528 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.629653 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.target_helper = tgtadm {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.629800 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.target_ip_address = 10.4.3.249 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.629927 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.target_port = 3260 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.630050 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.630170 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.target_protocol = iscsi {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.630295 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.630392 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.trace_flags = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.630456 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.unique_fqdn_network = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.630538 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.use_chap_auth = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.630612 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.630683 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.volume_backend_name = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.630777 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.volume_clear = zero {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.630853 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.volume_clear_ionice = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.630927 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.volume_clear_size = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.630998 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.631066 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.631138 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.631215 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.631286 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_reports.file_event_handler = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.631369 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.631460 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_reports.log_dir = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.631560 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.631637 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.631696 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.631800 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.631873 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.631942 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.632013 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.632079 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.632145 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.hostname = np0000004562 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.632216 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.632287 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.632368 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.632444 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.632516 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.632588 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.processname = cinder-backup {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.632660 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.632749 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.632829 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.632899 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.632971 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.633045 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.633117 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.633187 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.633257 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.633339 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.633414 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.633517 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.633594 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.633662 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.633753 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.ssl = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.633831 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.633904 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.633974 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.634040 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.634112 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.634183 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.634252 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.634338 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_notifications.driver = [] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.634416 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_notifications.retry = -1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.634487 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.634559 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.634632 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.634724 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.634834 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.barbican_api_version = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.634916 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.barbican_endpoint = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.634989 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.barbican_endpoint_type = public {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.635050 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.barbican_region_name = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.635126 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.cafile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.635221 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.certfile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.635353 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.collect_timing = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.635531 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.insecure = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.635592 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.keyfile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.635692 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.number_of_retries = 60 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.635825 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.retry_delay = 1 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.635943 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.send_service_user_token = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.636057 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.split_loggers = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.636159 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.timeout = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.636268 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.verify_ssl = True {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.636377 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican.verify_ssl_path = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.636460 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican_service_user.auth_section = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.636534 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican_service_user.auth_type = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.636607 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican_service_user.cafile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.636675 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican_service_user.certfile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.636789 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican_service_user.collect_timing = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.636874 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican_service_user.insecure = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.636946 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican_service_user.keyfile = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.637018 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican_service_user.split_loggers = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.637098 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] barbican_service_user.timeout = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.637154 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] vault.approle_role_id = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.637240 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] vault.approle_secret_id = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.637375 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] vault.kv_mountpoint = secret {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.637491 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] vault.kv_path = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.637609 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] vault.kv_version = 2 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.637723 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] vault.namespace = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.637843 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] vault.root_token_id = **** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.637932 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] vault.ssl_ca_crt_file = None {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.638022 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] vault.timeout = 60.0 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.638113 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] vault.use_ssl = False {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.638213 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 03:27:55.638312 np0000004562 cinder-backup[101413]: DEBUG oslo_service.backend._eventlet.service [None req-5280272a-08ae-4532-8e23-cded74a226f4 None None] ******************************************************************************** {{(pid=101413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 05 03:27:55.638579 np0000004562 cinder-backup[101413]: INFO cinder.service [-] Starting cinder-backup node (version 28.1.0) Jul 05 03:27:55.646773 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.lockutils [None req-f6534bae-7e12-47c5-bd09-c19114175e9d None None] Acquiring lock "cleanup_incomplete_backups_101413" by "cinder.backup.manager.BackupManager._cleanup_incomplete_backup_operations" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:27:55.647095 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.lockutils [None req-f6534bae-7e12-47c5-bd09-c19114175e9d None None] Lock "cleanup_incomplete_backups_101413" acquired by "cinder.backup.manager.BackupManager._cleanup_incomplete_backup_operations" :: waited 0.000s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:27:55.647189 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-f6534bae-7e12-47c5-bd09-c19114175e9d None None] Cleaning up incomplete backup operations. Jul 05 03:27:55.661372 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.lockutils [None req-f6534bae-7e12-47c5-bd09-c19114175e9d None None] Lock "cleanup_incomplete_backups_101413" "released" by "cinder.backup.manager.BackupManager._cleanup_incomplete_backup_operations" :: held 0.014s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:27:55.693364 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-f6534bae-7e12-47c5-bd09-c19114175e9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:27:55.698548 np0000004562 cinder-backup[101413]: DEBUG cinder.manager [None req-f6534bae-7e12-47c5-bd09-c19114175e9d None None] Notifying Schedulers of capabilities ... {{(pid=101413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:27:55.704988 np0000004562 cinder-backup[101413]: INFO cinder.keymgr.migration [None req-cb395fbc-9f02-4c21-b2bd-fa437572ad7b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 05 03:27:55.712736 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-f6534bae-7e12-47c5-bd09-c19114175e9d None None] Creating RPC server for service cinder-backup {{(pid=101413) start /opt/stack/cinder/cinder/service.py:231}} Jul 05 03:27:55.717328 np0000004562 cinder-backup[101413]: DEBUG cinder.service [None req-f6534bae-7e12-47c5-bd09-c19114175e9d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=101413) start /opt/stack/cinder/cinder/service.py:237}} Jul 05 03:28:05.716002 np0000004562 cinder-backup[101413]: DEBUG dbcounter [-] [101413] Writing DB stats cinder:SELECT=11,cinder:INSERT=1 {{(pid=101413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:29:11.735500 np0000004562 cinder-backup[101413]: DEBUG oslo_service.periodic_task [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:29:11.736229 np0000004562 cinder-backup[101413]: DEBUG cinder.manager [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Notifying Schedulers of capabilities ... {{(pid=101413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:30:05.746266 np0000004562 cinder-backup[101413]: DEBUG dbcounter [-] [101413] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:30:11.739399 np0000004562 cinder-backup[101413]: DEBUG oslo_service.periodic_task [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:30:11.741807 np0000004562 cinder-backup[101413]: DEBUG cinder.manager [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Notifying Schedulers of capabilities ... {{(pid=101413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:31:11.744451 np0000004562 cinder-backup[101413]: DEBUG oslo_service.periodic_task [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:31:11.744979 np0000004562 cinder-backup[101413]: DEBUG cinder.manager [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Notifying Schedulers of capabilities ... {{(pid=101413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:32:05.740453 np0000004562 cinder-backup[101413]: DEBUG dbcounter [-] [101413] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:32:11.742231 np0000004562 cinder-backup[101413]: DEBUG oslo_service.periodic_task [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:32:11.742581 np0000004562 cinder-backup[101413]: DEBUG cinder.manager [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Notifying Schedulers of capabilities ... {{(pid=101413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:32:23.257136 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Create backup started, backup: 94264060-4c36-41e2-b8bf-17049e555120 volume: 1c460f68-e03d-4cab-859a-b76d6d41acb1. Jul 05 03:32:23.263055 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupsadmintest-backup-container-1905781052',created_at=2026-07-05T03:32:23Z,data_timestamp=2026-07-05T03:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-1722118055',encryption_key_id=None,fail_reason=None,host='np0000004562',id=94264060-4c36-41e2-b8bf-17049e555120,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='b4ae15bee4f8457eb9df47225969a6d0',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='29d98430fbd943c3ae6d1b02a0f64fe3',volume_id=1c460f68-e03d-4cab-859a-b76d6d41acb1) Jul 05 03:32:23.297433 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_b4ae15bee4f8457eb9df47225969a6d0 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:32:23.297598 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:32:23.298150 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:32:23.299038 np0000004562 cinder-backup[101413]: INFO oslo.privsep.daemon [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpgzn2wnxt/privsep.sock'] Jul 05 03:32:23.307153 np0000004562 sudo[117274]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpgzn2wnxt/privsep.sock Jul 05 03:32:23.308053 np0000004562 sudo[117274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:32:23.537144 np0000004562 cinder-backup[101413]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 05 03:32:23.537277 np0000004562 cinder-backup[101413]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 03:32:23.537341 np0000004562 cinder-backup[101413]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 05 03:32:23.537397 np0000004562 cinder-backup[101413]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 03:32:23.537449 np0000004562 cinder-backup[101413]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 05 03:32:23.537503 np0000004562 cinder-backup[101413]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 05 03:32:23.537781 np0000004562 cinder-backup[101413]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 03:32:23.537781 np0000004562 cinder-backup[101413]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 03:32:23.537781 np0000004562 cinder-backup[101413]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 05 03:32:23.911028 np0000004562 cinder-backup[101413]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 05 03:32:23.911155 np0000004562 cinder-backup[101413]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 03:32:23.911466 np0000004562 cinder-backup[101413]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 05 03:32:23.911466 np0000004562 cinder-backup[101413]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 03:32:23.911466 np0000004562 cinder-backup[101413]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 05 03:32:23.911466 np0000004562 cinder-backup[101413]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 05 03:32:23.911657 np0000004562 cinder-backup[101413]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 03:32:23.911657 np0000004562 cinder-backup[101413]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 03:32:23.911657 np0000004562 cinder-backup[101413]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 05 03:32:24.202593 np0000004562 sudo[117274]: pam_unix(sudo:session): session closed for user root Jul 05 03:32:24.208874 np0000004562 cinder-backup[101413]: INFO oslo.privsep.daemon [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Spawned new privsep daemon via rootwrap Jul 05 03:32:24.209277 np0000004562 cinder-backup[101413]: DEBUG oslo.privsep.daemon [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Accepted privsep connection to /tmp/tmpgzn2wnxt/privsep.sock {{(pid=101413) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 05 03:32:24.344913 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:32:24.344913 np0000004562 cinder-backup[101413]: WARNING os_brick.initiator.connectors.nvmeof [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath' Jul 05 03:32:24.369930 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:24.380255 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:32:24.380509 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:32:24.393617 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:32:24.397432 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe1d:9945', 'fe80::20f3:8bff:fea8:962c', 'fe80::f816:3eff:fef9:d246', 'fe80::b410:eeff:fe9d:3572', 'fe80::f816:3eff:fe0a:c8e6', 'fe80::f816:3eff:fefe:62be', 'fe80::f816:3eff:fe73:41ed', 'fe80::f816:3eff:fe47:9ad0', 'fe80::f816:3eff:fe85:320d', 'fe80::3847:67ff:fe92:197', 'fe80::f816:3eff:fe58:5e2f'] Jul 05 03:32:24.397630 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:32:24.397754 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:32:24.400058 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] <== get_connector_properties: return (1099ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:32:24.917622 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:32:24.917997 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1c460f68-e03d-4cab-859a-b76d6d41acb1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1c460f68-e03d-4cab-859a-b76d6d41acb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:32:24.918168 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:32:25.878006 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.960s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:32:25.878686 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1c460f68-e03d-4cab-859a-b76d6d41acb1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1c460f68-e03d-4cab-859a-b76d6d41acb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:32:25.888898 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1c460f68-e03d-4cab-859a-b76d6d41acb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:32:25.889367 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1c460f68-e03d-4cab-859a-b76d6d41acb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:32:25.889587 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:32:25.904193 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:32:25.904193 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:25.920411 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1c460f68-e03d-4cab-859a-b76d6d41acb1] added Jul 05 03:32:25.920411 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:32:25.920411 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:32:25.920411 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:32:25.920411 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:32:25.920411 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:32:25.920411 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:25.920411 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:32:25.920411 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0291(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:32:25.920411 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:32:26.920193 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-1c460f68-e03d-4cab-859a-b76d6d41acb1 Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:32:26.934198 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:32:26.935617 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:26.946854 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:26.963237 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:26.963237 np0000004562 cinder-backup[101413]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:26.963237 np0000004562 cinder-backup[101413]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:26.963237 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:26.963237 np0000004562 cinder-backup[101413]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:26.963237 np0000004562 cinder-backup[101413]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:26.963237 np0000004562 cinder-backup[101413]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:26.963237 np0000004562 cinder-backup[101413]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:26.963237 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:32:26.963580 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:26.963580 np0000004562 cinder-backup[101413]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:26.963580 np0000004562 cinder-backup[101413]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:26.963580 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:26.963580 np0000004562 cinder-backup[101413]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:26.963580 np0000004562 cinder-backup[101413]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:26.963580 np0000004562 cinder-backup[101413]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:26.963580 np0000004562 cinder-backup[101413]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:26.963580 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:32:27.010365 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1c460f68-e03d-4cab-859a-b76d6d41acb1, portal: 192.168.40.100,3260] Jul 05 03:32:27.010365 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1c460f68-e03d-4cab-859a-b76d6d41acb1, portal: 192.168.40.100,3260] successful. Jul 05 03:32:27.010365 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:27.022439 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:27.041272 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:27.041272 np0000004562 cinder-backup[101413]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:27.041272 np0000004562 cinder-backup[101413]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:27.041272 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:27.041272 np0000004562 cinder-backup[101413]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:27.041272 np0000004562 cinder-backup[101413]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:27.041272 np0000004562 cinder-backup[101413]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:27.041272 np0000004562 cinder-backup[101413]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:27.041272 np0000004562 cinder-backup[101413]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c460f68-e03d-4cab-859a-b76d6d41acb1 (non-flash) Jul 05 03:32:27.041272 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:32:27.041613 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:27.041613 np0000004562 cinder-backup[101413]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:27.041613 np0000004562 cinder-backup[101413]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:27.041613 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:27.041613 np0000004562 cinder-backup[101413]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:27.041613 np0000004562 cinder-backup[101413]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:27.041613 np0000004562 cinder-backup[101413]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:27.041613 np0000004562 cinder-backup[101413]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:27.041613 np0000004562 cinder-backup[101413]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c460f68-e03d-4cab-859a-b76d6d41acb1 (non-flash) Jul 05 03:32:27.041613 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:32:27.041934 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1c460f68-e03d-4cab-859a-b76d6d41acb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:32:27.041934 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:32:27.043104 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] HCTL ('15', '-', '-', 0) found on session 31 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:32:27.043233 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Scanning host 15 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:32:27.056389 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Searching for a device in session 31 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:32:27.056567 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1c460f68-e03d-4cab-859a-b76d6d41acb1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1c460f68-e03d-4cab-859a-b76d6d41acb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:32:28.060315 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.182s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:32:28.060315 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] <== connect_volume: return (3142ms) {'type': 'block', 'scsi_wwn': '3300000004fa308ec', 'path': '/dev/sdj'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:32:28.061038 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdj {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:28.081805 np0000004562 sudo[117599]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdj Jul 05 03:32:28.082621 np0000004562 sudo[117599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:32:28.411291 np0000004562 sudo[117599]: pam_unix(sudo:session): session closed for user root Jul 05 03:32:28.413482 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdj" returned: 0 in 0.352s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:28.457664 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:32:28.464081 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] _create_container started, container: tempest-volumesbackupsadmintest-backup-container-1905781052,backup: 94264060-4c36-41e2-b8bf-17049e555120. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:32:28.746427 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] generate_object_name_prefix: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120 {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:32:28.755819 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] starting backup of volume: 1c460f68-e03d-4cab-859a-b76d6d41acb1, volume size: 1073741824, object names prefix volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:32:28.961302 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:32:29.206832 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:32:29.206832 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:32:29.327080 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:32:29.327223 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:32:29.545273 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:32:29.791808 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:32:29.792021 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:32:29.893835 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:32:29.894061 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:32:30.085566 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:32:30.346426 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:32:30.346888 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:32:30.451131 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:32:30.451403 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:32:30.639360 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:32:30.881776 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:32:30.882054 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:32:30.990850 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:32:30.991103 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:32:31.188537 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:32:31.440359 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:32:31.440359 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:32:31.545560 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:32:31.545761 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:32:31.767551 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:32:32.028026 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:32:32.028255 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:32:32.135982 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:32:32.136183 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:32:32.347497 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:32:32.607543 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:32:32.607543 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:32:32.708811 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:32:32.708937 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:32:32.906983 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:32:33.166400 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:32:33.166482 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:32:33.267363 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:32:33.267582 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:32:33.462136 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:32:33.718094 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:32:33.718520 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:32:33.824998 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:32:33.825153 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:32:34.031636 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:32:34.283683 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:32:34.283909 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:32:34.411540 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:32:34.411799 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:32:34.641946 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:32:34.898214 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:32:34.898980 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:32:35.018885 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:32:35.019118 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:32:35.255538 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:32:35.519314 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:32:35.519520 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:32:35.632251 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:32:35.632454 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:32:35.838353 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:32:36.095854 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:32:36.096245 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:32:36.253391 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:32:36.253391 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:32:36.505223 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:32:36.782071 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:32:36.782532 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:32:36.909870 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:32:36.911436 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:32:37.195237 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:32:37.452340 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:32:37.452340 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:32:37.554549 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:32:37.554549 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:32:37.774739 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:32:38.063883 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:32:38.063883 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:32:38.183303 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:32:38.183490 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:32:38.476350 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:32:38.795742 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:32:38.795873 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:32:38.908122 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:32:38.908356 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:32:39.129408 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:32:39.387721 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:32:39.387939 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:32:39.498977 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:32:39.499435 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:32:39.760805 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:32:40.037496 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:32:40.038053 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:32:40.144632 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:32:40.144824 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:32:40.335822 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:32:40.606053 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:32:40.606544 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:32:40.727216 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:32:40.727461 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:32:40.860375 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:32:40.993598 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:32:40.993809 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:32:41.082411 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:32:41.082571 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:32:41.089407 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:32:41.094432 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:32:41.094584 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:32:41.101276 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:32:41.101353 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:32:41.106610 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:32:41.106922 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] _write_sha256file started, container name: tempest-volumesbackupsadmintest-backup-container-1905781052, sha256file filename: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:32:41.165505 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:32:41.166263 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] _write_metadata started, container name: tempest-volumesbackupsadmintest-backup-container-1905781052, metadata filename: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:32:41.194312 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "94264060-4c36-41e2-b8bf-17049e555120",\n "backup_name": "tempest-VolumesBackupsAdminTest-Backup-1722118055",\n "created_at": "2026-07-05 03:32:23+00:00",\n "objects": [\n {\n "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "1c460f68-e03d-4cab-859a-b76d6d41acb1",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"1c460f68-e03d-4cab-859a-b76d6d41acb1\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"29d98430fbd943c3ae6d1b02a0f64fe3\\", \\"project_id\\": \\"b4ae15bee4f8457eb9df47225969a6d0\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:32:22.000000\\", \\"launched_at\\": \\"2026-07-05T03:32:22.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsAdminTest-Volume-490002814\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:32:22.000000\\", \\"updated_at\\": \\"2026-07-05T03:32:23.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:32:41.200094 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] backup 94264060-4c36-41e2-b8bf-17049e555120 finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:32:41.333268 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdj {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:41.351182 np0000004562 sudo[118135]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdj Jul 05 03:32:41.351833 np0000004562 sudo[118135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:32:41.644822 np0000004562 sudo[118135]: pam_unix(sudo:session): session closed for user root Jul 05 03:32:41.647484 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdj" returned: 0 in 0.314s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:41.648719 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1c460f68-e03d-4cab-859a-b76d6d41acb1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1c460f68-e03d-4cab-859a-b76d6d41acb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '3300000004fa308ec', 'path': '/dev/sdj'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:32:41.648719 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:32:41.649006 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:32:41.649789 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1c460f68-e03d-4cab-859a-b76d6d41acb1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1c460f68-e03d-4cab-859a-b76d6d41acb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:32:41.661575 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:32:41.661575 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:32:41.661575 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:32:41.661575 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:32:41.661575 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:32:41.661575 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 Jul 05 03:32:41.661575 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:32:41.661575 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:32:41.661575 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:32:41.661575 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:32:41.661575 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c Jul 05 03:32:41.661575 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:32:41.661575 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:32:41.661575 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:32:41.661575 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:32:41.661575 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-1c460f68-e03d-4cab-859a-b76d6d41acb1 Jul 05 03:32:41.661575 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:32:41.661575 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:32:41.661575 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b Jul 05 03:32:41.661575 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:32:41.661575 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:32:41.661575 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:32:41.661575 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:32:41.661575 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 Jul 05 03:32:41.661575 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:32:41.661575 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:32:41.661575 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:32:41.661575 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:32:41.661575 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:32:41.661575 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:32:41.661575 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:32:41.662423 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:32:41.662423 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:32:41.662423 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:32:41.662423 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1c460f68-e03d-4cab-859a-b76d6d41acb1', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:32:41.686476 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:41.686476 np0000004562 cinder-backup[101413]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:41.686476 np0000004562 cinder-backup[101413]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:41.686476 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:41.686476 np0000004562 cinder-backup[101413]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:41.686476 np0000004562 cinder-backup[101413]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:41.686476 np0000004562 cinder-backup[101413]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:41.686476 np0000004562 cinder-backup[101413]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:41.686476 np0000004562 cinder-backup[101413]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c460f68-e03d-4cab-859a-b76d6d41acb1 (non-flash) Jul 05 03:32:41.686476 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:32:41.686836 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:41.686836 np0000004562 cinder-backup[101413]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:41.686836 np0000004562 cinder-backup[101413]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:41.686836 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:41.686836 np0000004562 cinder-backup[101413]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:41.686836 np0000004562 cinder-backup[101413]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b (non-flash) Jul 05 03:32:41.686836 np0000004562 cinder-backup[101413]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:41.686836 np0000004562 cinder-backup[101413]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:41.686836 np0000004562 cinder-backup[101413]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c460f68-e03d-4cab-859a-b76d6d41acb1 (non-flash) Jul 05 03:32:41.686836 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:32:41.686836 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-614876c0-4fe6-4f48-9a0c-c593830cf43b', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1c460f68-e03d-4cab-859a-b76d6d41acb1', '31')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:32:41.687127 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1c460f68-e03d-4cab-859a-b76d6d41acb1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1c460f68-e03d-4cab-859a-b76d6d41acb1', '31')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:32:41.688137 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Resulting device map defaultdict(. at 0x72a48eb36d40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1c460f68-e03d-4cab-859a-b76d6d41acb1'): ({'sdj'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:32:41.688550 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Removing single pathed devices sdj {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:32:41.698669 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Flushing IO for device /dev/sdj {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:32:41.707940 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:32:41.755330 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Checking to see if SCSI volumes sdj have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:32:41.755492 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] SCSI volumes sdj have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:32:41.758820 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Checking to see if device paths {'sdj'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:32:41.768971 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Device paths {'sdj'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:32:41.769259 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1c460f68-e03d-4cab-859a-b76d6d41acb1')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:32:41.780265 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:41.815069 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2023-03.storpool.com:os--volume-1c460f68-e03d-4cab-859a-b76d6d41acb1, portal: 192.168.40.100,3260] Jul 05 03:32:41.815069 np0000004562 cinder-backup[101413]: Logout of [sid: 31, target: iqn.2023-03.storpool.com:os--volume-1c460f68-e03d-4cab-859a-b76d6d41acb1, portal: 192.168.40.100,3260] successful. Jul 05 03:32:41.815069 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:41.842610 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:41.842610 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.193s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:32:41.842610 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] <== disconnect_volume: return (193ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:32:42.868422 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-c6d58334-ecf7-428b-bc0c-f95591b07690 tempest-VolumesBackupsAdminTest-1605990610 None] Create backup finished. backup: 94264060-4c36-41e2-b8bf-17049e555120. Jul 05 03:32:43.967807 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-0826b795-4314-40e4-89a6-5460b891e6b2 tempest-VolumesBackupsAdminTest-889997415 None] Export record started, backup: 94264060-4c36-41e2-b8bf-17049e555120. Jul 05 03:32:43.972825 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-0826b795-4314-40e4-89a6-5460b891e6b2 tempest-VolumesBackupsAdminTest-889997415 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_b949de30a7924ad9bb0899522a4aea23 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:32:43.973865 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-0826b795-4314-40e4-89a6-5460b891e6b2 tempest-VolumesBackupsAdminTest-889997415 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:32:43.975040 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-0826b795-4314-40e4-89a6-5460b891e6b2 tempest-VolumesBackupsAdminTest-889997415 None] Export record finished, backup 94264060-4c36-41e2-b8bf-17049e555120 exported. Jul 05 03:32:44.583999 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-f5d2ea33-88b0-40d8-96b2-631c180f4d9d tempest-VolumesBackupsAdminTest-889997415 None] Import record started, backup_url: eyJkcml2ZXJfaW5mbyI6IHt9LCAiaWQiOiAiZWI0Yjg2ZTUtOGMxYS00NTk2LWJhMmItM2EyOTE4NGIxYmE2IiwgInVzZXJfaWQiOiAiMjlkOTg0MzBmYmQ5NDNjM2FlNmQxYjAyYTBmNjRmZTMiLCAicHJvamVjdF9pZCI6ICJiNGFlMTViZWU0Zjg0NTdlYjlkZjQ3MjI1OTY5YTZkMCIsICJ2b2x1bWVfaWQiOiAiMWM0NjBmNjgtZTAzZC00Y2FiLTg1OWEtYjc2ZDZkNDFhY2IxIiwgImhvc3QiOiAibnAwMDAwMDA0NTYyIiwgImF2YWlsYWJpbGl0eV96b25lIjogIm5vdmEiLCAiY29udGFpbmVyIjogInRlbXBlc3Qtdm9sdW1lc2JhY2t1cHNhZG1pbnRlc3QtYmFja3VwLWNvbnRhaW5lci0xOTA1NzgxMDUyIiwgInBhcmVudF9pZCI6IG51bGwsICJzdGF0dXMiOiAiYXZhaWxhYmxlIiwgImZhaWxfcmVhc29uIjogbnVsbCwgInNpemUiOiAxLCAiZGlzcGxheV9uYW1lIjogInRlbXBlc3QtVm9sdW1lc0JhY2t1cHNBZG1pblRlc3QtQmFja3VwLTE3MjIxMTgwNTUiLCAiZGlzcGxheV9kZXNjcmlwdGlvbiI6IG51bGwsICJzZXJ2aWNlX21ldGFkYXRhIjogInZvbHVtZV8xYzQ2MGY2OC1lMDNkLTRjYWItODU5YS1iNzZkNmQ0MWFjYjEvMjAyNjA3MDUwMzMyMjgvYXpfbm92YV9iYWNrdXBfOTQyNjQwNjAtNGMzNi00MWUyLWI4YmYtMTcwNDllNTU1MTIwIiwgInNlcnZpY2UiOiAiY2luZGVyLmJhY2t1cC5kcml2ZXJzLnN3aWZ0LlN3aWZ0QmFja3VwRHJpdmVyIiwgIm9iamVjdF9jb3VudCI6IDIxLCAidGVtcF92b2x1bWVfaWQiOiBudWxsLCAidGVtcF9zbmFwc2hvdF9pZCI6IG51bGwsICJudW1fZGVwZW5kZW50X2JhY2t1cHMiOiAwLCAic25hcHNob3RfaWQiOiBudWxsLCAiZGF0YV90aW1lc3RhbXAiOiAiMjAyNi0wNy0wNVQwMzozMjoyM1oiLCAicmVzdG9yZV92b2x1bWVfaWQiOiBudWxsLCAibWV0YWRhdGEiOiB7fSwgImVuY3J5cHRpb25fa2V5X2lkIjogbnVsbCwgImNyZWF0ZWRfYXQiOiAiMjAyNi0wNy0wNVQwMzozMjoyM1oiLCAidXBkYXRlZF9hdCI6ICIyMDI2LTA3LTA1VDAzOjMyOjQzWiIsICJkZWxldGVkX2F0IjogbnVsbCwgImRlbGV0ZWQiOiBmYWxzZX0=. Jul 05 03:32:44.585959 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-f5d2ea33-88b0-40d8-96b2-631c180f4d9d tempest-VolumesBackupsAdminTest-889997415 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_b949de30a7924ad9bb0899522a4aea23 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:32:44.586163 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-f5d2ea33-88b0-40d8-96b2-631c180f4d9d tempest-VolumesBackupsAdminTest-889997415 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:32:44.638249 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-f5d2ea33-88b0-40d8-96b2-631c180f4d9d tempest-VolumesBackupsAdminTest-889997415 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:32:44.670597 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-f5d2ea33-88b0-40d8-96b2-631c180f4d9d tempest-VolumesBackupsAdminTest-889997415 None] Import record id eb4b86e5-8c1a-4596-ba2b-3a29184b1ba6 metadata from driver finished. Jul 05 03:32:46.995206 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Restore backup started, backup: 94264060-4c36-41e2-b8bf-17049e555120 volume: b9f9799a-9525-469f-95c3-95a64494c1da. Jul 05 03:32:47.011209 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_b4ae15bee4f8457eb9df47225969a6d0 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:32:47.011611 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:32:47.011648 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:32:47.024559 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:32:47.043041 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:47.054160 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:32:47.054488 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:32:47.062292 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:32:47.064096 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe1d:9945', 'fe80::20f3:8bff:fea8:962c', 'fe80::f816:3eff:fef9:d246', 'fe80::b410:eeff:fe9d:3572', 'fe80::f816:3eff:fe0a:c8e6', 'fe80::f816:3eff:fefe:62be', 'fe80::f816:3eff:fe73:41ed', 'fe80::f816:3eff:fe47:9ad0', 'fe80::f816:3eff:fe85:320d', 'fe80::3847:67ff:fe92:197', 'fe80::f816:3eff:fe19:b53', 'fe80::f816:3eff:fece:4a0c', 'fe80::4003:aff:fe73:5fc', 'fe80::f816:3eff:feb8:5256', 'fe80::4477:57ff:fecf:c6f0', 'fe80::f816:3eff:fe04:aa', 'fe80::3037:dfff:fed9:26e2'] Jul 05 03:32:47.064272 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:32:47.064436 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:32:47.066398 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] <== get_connector_properties: return (52ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:32:48.073837 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:32:48.074274 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9f9799a-9525-469f-95c3-95a64494c1da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9f9799a-9525-469f-95c3-95a64494c1da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:32:48.074444 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:32:48.074949 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:32:48.075146 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9f9799a-9525-469f-95c3-95a64494c1da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9f9799a-9525-469f-95c3-95a64494c1da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:32:48.085660 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b9f9799a-9525-469f-95c3-95a64494c1da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:32:48.086157 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b9f9799a-9525-469f-95c3-95a64494c1da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:32:48.086445 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:32:48.096165 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:32:48.096165 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:48.107370 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b9f9799a-9525-469f-95c3-95a64494c1da] added Jul 05 03:32:48.107370 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:32:48.107370 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:32:48.107370 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:32:48.107370 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:32:48.107370 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:32:48.107370 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:48.107573 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:32:48.108593 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0214(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:32:48.108593 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:32:49.109067 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-b9f9799a-9525-469f-95c3-95a64494c1da Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:32:49.124089 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:49.140230 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:49.158500 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:49.158500 np0000004562 cinder-backup[101413]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:49.158500 np0000004562 cinder-backup[101413]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:49.158500 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:49.158500 np0000004562 cinder-backup[101413]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:49.158500 np0000004562 cinder-backup[101413]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:49.158500 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:32:49.158500 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:49.158500 np0000004562 cinder-backup[101413]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:49.158500 np0000004562 cinder-backup[101413]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:49.158500 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:49.158500 np0000004562 cinder-backup[101413]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:49.158500 np0000004562 cinder-backup[101413]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:49.158500 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:32:49.204201 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b9f9799a-9525-469f-95c3-95a64494c1da, portal: 192.168.40.100,3260] Jul 05 03:32:49.204201 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b9f9799a-9525-469f-95c3-95a64494c1da, portal: 192.168.40.100,3260] successful. Jul 05 03:32:49.204201 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:49.219133 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:49.238197 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:49.238197 np0000004562 cinder-backup[101413]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:49.238197 np0000004562 cinder-backup[101413]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:49.238197 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:49.238197 np0000004562 cinder-backup[101413]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:49.238197 np0000004562 cinder-backup[101413]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:49.238197 np0000004562 cinder-backup[101413]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9f9799a-9525-469f-95c3-95a64494c1da (non-flash) Jul 05 03:32:49.238197 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:32:49.238613 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:49.238613 np0000004562 cinder-backup[101413]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:49.238613 np0000004562 cinder-backup[101413]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:49.238613 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:49.238613 np0000004562 cinder-backup[101413]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:49.238613 np0000004562 cinder-backup[101413]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:49.238613 np0000004562 cinder-backup[101413]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9f9799a-9525-469f-95c3-95a64494c1da (non-flash) Jul 05 03:32:49.238613 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:32:49.238887 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b9f9799a-9525-469f-95c3-95a64494c1da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:32:49.238887 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:32:49.239800 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] HCTL ('7', '-', '-', 0) found on session 32 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:32:49.239963 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:32:49.255244 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Searching for a device in session 32 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:32:49.255463 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9f9799a-9525-469f-95c3-95a64494c1da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9f9799a-9525-469f-95c3-95a64494c1da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:32:50.259545 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.184s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:32:50.260077 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] <== connect_volume: return (2185ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445798947', 'path': '/dev/sdb'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:32:50.260216 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:50.279558 np0000004562 sudo[118618]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 05 03:32:50.280384 np0000004562 sudo[118618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:32:50.645528 np0000004562 sudo[118618]: pam_unix(sudo:session): session closed for user root Jul 05 03:32:50.648146 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.387s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:50.648691 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] starting restore of backup volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120 container: tempest-volumesbackupsadmintest-backup-container-1905781052, to new volume b9f9799a-9525-469f-95c3-95a64494c1da, backup: 94264060-4c36-41e2-b8bf-17049e555120. {{(pid=101413) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jul 05 03:32:50.648991 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] _read_metadata started, container name: tempest-volumesbackupsadmintest-backup-container-1905781052, metadata filename: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120_metadata. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] _read_metadata finished. Metadata: { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "backup_description": null, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "backup_id": "94264060-4c36-41e2-b8bf-17049e555120", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "backup_name": "tempest-VolumesBackupsAdminTest-Backup-1722118055", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "created_at": "2026-07-05 03:32:23+00:00", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "objects": [ Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00001": { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "offset": 0 Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00002": { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "offset": 52428800 Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00003": { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "offset": 104857600 Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00004": { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "offset": 157286400 Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00005": { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "offset": 209715200 Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00006": { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "offset": 262144000 Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00007": { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "offset": 314572800 Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00008": { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "offset": 367001600 Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00009": { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "offset": 419430400 Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00010": { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "offset": 471859200 Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00011": { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "offset": 524288000 Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00012": { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "offset": 576716800 Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00013": { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "offset": 629145600 Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00014": { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "offset": 681574400 Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00015": { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "offset": 734003200 Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00016": { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "offset": 786432000 Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00017": { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "offset": 838860800 Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00018": { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "offset": 891289600 Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00019": { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "offset": 943718400 Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00020": { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "offset": 996147200 Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00021": { Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "length": 25165824, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "offset": 1048576000 Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: ], Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "parent_id": null, Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "version": "1.0.0", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "volume_id": "1c460f68-e03d-4cab-859a-b76d6d41acb1", Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"1c460f68-e03d-4cab-859a-b76d6d41acb1\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"29d98430fbd943c3ae6d1b02a0f64fe3\", \"project_id\": \"b4ae15bee4f8457eb9df47225969a6d0\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004562@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T03:32:22.000000\", \"launched_at\": \"2026-07-05T03:32:22.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsAdminTest-Volume-490002814\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"ac464b70-f08d-447b-aa26-2823b4948fc2\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T03:32:22.000000\", \"updated_at\": \"2026-07-05T03:32:23.000000\"}}" Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: }. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Restoring backup version 1.0.0 {{(pid=101413) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jul 05 03:32:50.669517 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] _read_metadata started, container name: tempest-volumesbackupsadmintest-backup-container-1905781052, metadata filename: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120_metadata. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] _read_metadata finished. Metadata: { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "backup_description": null, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "backup_id": "94264060-4c36-41e2-b8bf-17049e555120", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "backup_name": "tempest-VolumesBackupsAdminTest-Backup-1722118055", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "created_at": "2026-07-05 03:32:23+00:00", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "objects": [ Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00001": { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "offset": 0 Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00002": { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "offset": 52428800 Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00003": { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "offset": 104857600 Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00004": { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "offset": 157286400 Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00005": { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "offset": 209715200 Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00006": { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "offset": 262144000 Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00007": { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "offset": 314572800 Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00008": { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "offset": 367001600 Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00009": { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "offset": 419430400 Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00010": { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "offset": 471859200 Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00011": { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "offset": 524288000 Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00012": { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "offset": 576716800 Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00013": { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "offset": 629145600 Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00014": { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "offset": 681574400 Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00015": { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "offset": 734003200 Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00016": { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "offset": 786432000 Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00017": { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "offset": 838860800 Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00018": { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "offset": 891289600 Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00019": { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "offset": 943718400 Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00020": { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "offset": 996147200 Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: }, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00021": { Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "length": 25165824, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "offset": 1048576000 Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: } Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: ], Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "parent_id": null, Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "version": "1.0.0", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "volume_id": "1c460f68-e03d-4cab-859a-b76d6d41acb1", Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"1c460f68-e03d-4cab-859a-b76d6d41acb1\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"29d98430fbd943c3ae6d1b02a0f64fe3\", \"project_id\": \"b4ae15bee4f8457eb9df47225969a6d0\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004562@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T03:32:22.000000\", \"launched_at\": \"2026-07-05T03:32:22.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsAdminTest-Volume-490002814\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"ac464b70-f08d-447b-aa26-2823b4948fc2\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T03:32:22.000000\", \"updated_at\": \"2026-07-05T03:32:23.000000\"}}" Jul 05 03:32:50.693086 np0000004562 cinder-backup[101413]: }. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 03:32:50.698888 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] v1 volume backup restore of 94264060-4c36-41e2-b8bf-17049e555120 started. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 05 03:32:50.698888 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] metadata_object_names = ['volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00001', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00002', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00003', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00004', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00005', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00006', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00007', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00008', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00009', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00010', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00011', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00012', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00013', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00014', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00015', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00016', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00017', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00018', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00019', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00020', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00021']. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 05 03:32:50.758032 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] generated object list: ['volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00001', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00002', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00003', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00004', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00005', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00006', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00007', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00008', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00009', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00010', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00011', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00012', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00013', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00014', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00015', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00016', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00017', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00018', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00019', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00020', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00021', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120_metadata', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:32:50.819003 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:32:50.825015 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] restoring object. backup: 94264060-4c36-41e2-b8bf-17049e555120, container: tempest-volumesbackupsadmintest-backup-container-1905781052, object name: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00001, volume: b9f9799a-9525-469f-95c3-95a64494c1da. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:32:50.847254 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:32:51.238835 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] restoring object. backup: 94264060-4c36-41e2-b8bf-17049e555120, container: tempest-volumesbackupsadmintest-backup-container-1905781052, object name: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00002, volume: b9f9799a-9525-469f-95c3-95a64494c1da. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:32:51.261006 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:32:51.621671 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] restoring object. backup: 94264060-4c36-41e2-b8bf-17049e555120, container: tempest-volumesbackupsadmintest-backup-container-1905781052, object name: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00003, volume: b9f9799a-9525-469f-95c3-95a64494c1da. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:32:51.637674 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:32:52.009285 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] restoring object. backup: 94264060-4c36-41e2-b8bf-17049e555120, container: tempest-volumesbackupsadmintest-backup-container-1905781052, object name: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00004, volume: b9f9799a-9525-469f-95c3-95a64494c1da. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:32:52.024043 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:32:52.531862 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] restoring object. backup: 94264060-4c36-41e2-b8bf-17049e555120, container: tempest-volumesbackupsadmintest-backup-container-1905781052, object name: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00005, volume: b9f9799a-9525-469f-95c3-95a64494c1da. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:32:52.551022 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:32:52.909016 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] restoring object. backup: 94264060-4c36-41e2-b8bf-17049e555120, container: tempest-volumesbackupsadmintest-backup-container-1905781052, object name: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00006, volume: b9f9799a-9525-469f-95c3-95a64494c1da. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:32:52.930527 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:32:53.315155 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] restoring object. backup: 94264060-4c36-41e2-b8bf-17049e555120, container: tempest-volumesbackupsadmintest-backup-container-1905781052, object name: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00007, volume: b9f9799a-9525-469f-95c3-95a64494c1da. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:32:53.338189 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:32:53.684417 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] restoring object. backup: 94264060-4c36-41e2-b8bf-17049e555120, container: tempest-volumesbackupsadmintest-backup-container-1905781052, object name: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00008, volume: b9f9799a-9525-469f-95c3-95a64494c1da. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:32:53.700295 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:32:54.035481 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] restoring object. backup: 94264060-4c36-41e2-b8bf-17049e555120, container: tempest-volumesbackupsadmintest-backup-container-1905781052, object name: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00009, volume: b9f9799a-9525-469f-95c3-95a64494c1da. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:32:54.066174 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:32:54.412732 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] restoring object. backup: 94264060-4c36-41e2-b8bf-17049e555120, container: tempest-volumesbackupsadmintest-backup-container-1905781052, object name: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00010, volume: b9f9799a-9525-469f-95c3-95a64494c1da. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:32:54.434136 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:32:54.800946 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] restoring object. backup: 94264060-4c36-41e2-b8bf-17049e555120, container: tempest-volumesbackupsadmintest-backup-container-1905781052, object name: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00011, volume: b9f9799a-9525-469f-95c3-95a64494c1da. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:32:54.816823 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:32:55.200886 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] restoring object. backup: 94264060-4c36-41e2-b8bf-17049e555120, container: tempest-volumesbackupsadmintest-backup-container-1905781052, object name: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00012, volume: b9f9799a-9525-469f-95c3-95a64494c1da. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:32:55.220589 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:32:55.590895 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] restoring object. backup: 94264060-4c36-41e2-b8bf-17049e555120, container: tempest-volumesbackupsadmintest-backup-container-1905781052, object name: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00013, volume: b9f9799a-9525-469f-95c3-95a64494c1da. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:32:55.604986 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:32:55.938038 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] restoring object. backup: 94264060-4c36-41e2-b8bf-17049e555120, container: tempest-volumesbackupsadmintest-backup-container-1905781052, object name: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00014, volume: b9f9799a-9525-469f-95c3-95a64494c1da. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:32:55.953987 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:32:56.346287 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] restoring object. backup: 94264060-4c36-41e2-b8bf-17049e555120, container: tempest-volumesbackupsadmintest-backup-container-1905781052, object name: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00015, volume: b9f9799a-9525-469f-95c3-95a64494c1da. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:32:56.361515 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:32:56.680114 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] restoring object. backup: 94264060-4c36-41e2-b8bf-17049e555120, container: tempest-volumesbackupsadmintest-backup-container-1905781052, object name: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00016, volume: b9f9799a-9525-469f-95c3-95a64494c1da. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:32:56.693173 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:32:57.024264 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] restoring object. backup: 94264060-4c36-41e2-b8bf-17049e555120, container: tempest-volumesbackupsadmintest-backup-container-1905781052, object name: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00017, volume: b9f9799a-9525-469f-95c3-95a64494c1da. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:32:57.037843 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:32:57.426359 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] restoring object. backup: 94264060-4c36-41e2-b8bf-17049e555120, container: tempest-volumesbackupsadmintest-backup-container-1905781052, object name: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00018, volume: b9f9799a-9525-469f-95c3-95a64494c1da. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:32:57.439473 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:32:57.785169 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] restoring object. backup: 94264060-4c36-41e2-b8bf-17049e555120, container: tempest-volumesbackupsadmintest-backup-container-1905781052, object name: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00019, volume: b9f9799a-9525-469f-95c3-95a64494c1da. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:32:57.815440 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:32:58.166550 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] restoring object. backup: 94264060-4c36-41e2-b8bf-17049e555120, container: tempest-volumesbackupsadmintest-backup-container-1905781052, object name: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00020, volume: b9f9799a-9525-469f-95c3-95a64494c1da. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:32:58.183936 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:32:58.517793 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] restoring object. backup: 94264060-4c36-41e2-b8bf-17049e555120, container: tempest-volumesbackupsadmintest-backup-container-1905781052, object name: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00021, volume: b9f9799a-9525-469f-95c3-95a64494c1da. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:32:58.534518 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:32:58.699564 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] v1 volume backup restore of 94264060-4c36-41e2-b8bf-17049e555120 finished. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 05 03:32:58.699801 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Restoring volume base metadata {{(pid=101413) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 05 03:32:58.715284 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] No metadata of type 'volume-metadata' to restore {{(pid=101413) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 05 03:32:58.715433 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=101413) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 05 03:32:58.715569 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] restore 94264060-4c36-41e2-b8bf-17049e555120 to b9f9799a-9525-469f-95c3-95a64494c1da finished. {{(pid=101413) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jul 05 03:32:58.716013 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:32:58.738609 np0000004562 sudo[118805]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 05 03:32:58.739518 np0000004562 sudo[118805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:32:59.078385 np0000004562 sudo[118805]: pam_unix(sudo:session): session closed for user root Jul 05 03:32:59.081279 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.364s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:32:59.081706 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9f9799a-9525-469f-95c3-95a64494c1da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9f9799a-9525-469f-95c3-95a64494c1da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445798947', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:32:59.081929 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:32:59.082420 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:32:59.084301 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9f9799a-9525-469f-95c3-95a64494c1da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9f9799a-9525-469f-95c3-95a64494c1da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:32:59.101235 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:32:59.101235 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:32:59.101235 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:32:59.101235 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:32:59.101235 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:32:59.101235 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 Jul 05 03:32:59.101235 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:32:59.101235 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:32:59.101235 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:32:59.101235 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:32:59.101235 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c Jul 05 03:32:59.101235 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:32:59.101235 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:32:59.101235 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:32:59.101235 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:32:59.101235 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-b9f9799a-9525-469f-95c3-95a64494c1da Jul 05 03:32:59.101235 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:32:59.101235 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:32:59.101235 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 Jul 05 03:32:59.101235 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:32:59.101235 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:32:59.101235 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:32:59.101235 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:32:59.101235 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:32:59.101235 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:32:59.101235 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:32:59.101235 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:32:59.101235 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:32:59.101235 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:32:59.101830 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9f9799a-9525-469f-95c3-95a64494c1da', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:32:59.129891 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:59.129891 np0000004562 cinder-backup[101413]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:59.129891 np0000004562 cinder-backup[101413]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:59.129891 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:59.129891 np0000004562 cinder-backup[101413]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:59.129891 np0000004562 cinder-backup[101413]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:59.129891 np0000004562 cinder-backup[101413]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9f9799a-9525-469f-95c3-95a64494c1da (non-flash) Jul 05 03:32:59.129891 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:32:59.130219 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:59.130219 np0000004562 cinder-backup[101413]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7 (non-flash) Jul 05 03:32:59.130219 np0000004562 cinder-backup[101413]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:59.130219 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:32:59.130219 np0000004562 cinder-backup[101413]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:59.130219 np0000004562 cinder-backup[101413]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:32:59.130219 np0000004562 cinder-backup[101413]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9f9799a-9525-469f-95c3-95a64494c1da (non-flash) Jul 05 03:32:59.130219 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:32:59.130425 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b0c2e-22d2-495f-95e7-3632d4841ab7', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', '26'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9f9799a-9525-469f-95c3-95a64494c1da', '32')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:32:59.130486 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b9f9799a-9525-469f-95c3-95a64494c1da, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9f9799a-9525-469f-95c3-95a64494c1da', '32')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:32:59.131664 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Resulting device map defaultdict(. at 0x72a48ebb5120>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9f9799a-9525-469f-95c3-95a64494c1da'): ({'sdb'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:32:59.131984 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Removing single pathed devices sdb {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:32:59.144550 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Flushing IO for device /dev/sdb {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:32:59.153061 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:32:59.217257 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:32:59.217644 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:32:59.218526 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:32:59.229545 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:32:59.229889 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9f9799a-9525-469f-95c3-95a64494c1da')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:32:59.242120 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:59.281352 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2023-03.storpool.com:os--volume-b9f9799a-9525-469f-95c3-95a64494c1da, portal: 192.168.40.100,3260] Jul 05 03:32:59.281352 np0000004562 cinder-backup[101413]: Logout of [sid: 32, target: iqn.2023-03.storpool.com:os--volume-b9f9799a-9525-469f-95c3-95a64494c1da, portal: 192.168.40.100,3260] successful. Jul 05 03:32:59.281352 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:59.299580 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:32:59.299804 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.217s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:32:59.300124 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] <== disconnect_volume: return (218ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:33:00.315597 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.manager [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Encryption key ID for volume b9f9799a-9525-469f-95c3-95a64494c1da already matches encryption key ID in backup 94264060-4c36-41e2-b8bf-17049e555120. {{(pid=101413) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jul 05 03:33:00.344805 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-cd146892-6d44-42f5-99fc-d8f79061280f tempest-VolumesBackupsAdminTest-1605990610 None] Finished restoring backup 94264060-4c36-41e2-b8bf-17049e555120 to volume b9f9799a-9525-469f-95c3-95a64494c1da. Jul 05 03:33:00.519312 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-53746842-8e88-4fd0-9654-94ec310492e7 tempest-VolumesBackupsAdminTest-889997415 None] Delete backup started, backup: eb4b86e5-8c1a-4596-ba2b-3a29184b1ba6. Jul 05 03:33:00.527566 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-53746842-8e88-4fd0-9654-94ec310492e7 tempest-VolumesBackupsAdminTest-889997415 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_b949de30a7924ad9bb0899522a4aea23 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:33:00.530303 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-53746842-8e88-4fd0-9654-94ec310492e7 tempest-VolumesBackupsAdminTest-889997415 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:33:00.530656 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-53746842-8e88-4fd0-9654-94ec310492e7 tempest-VolumesBackupsAdminTest-889997415 None] delete started, backup: eb4b86e5-8c1a-4596-ba2b-3a29184b1ba6, container: tempest-volumesbackupsadmintest-backup-container-1905781052, prefix: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:33:00.770980 np0000004562 cinder-backup[101413]: WARNING cinder.backup.chunkeddriver [None req-53746842-8e88-4fd0-9654-94ec310492e7 tempest-VolumesBackupsAdminTest-889997415 None] Error while listing objects, continuing with delete.: swiftclient.exceptions.ClientException: Container GET failed: https://10.4.3.249:8080/v1/AUTH_b949de30a7924ad9bb0899522a4aea23/tempest-volumesbackupsadmintest-backup-container-1905781052?format=json&prefix=volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' (txn: txdc35a123d2874f60aaa3b-006a49d06c) Jul 05 03:33:00.770980 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-53746842-8e88-4fd0-9654-94ec310492e7 tempest-VolumesBackupsAdminTest-889997415 None] delete eb4b86e5-8c1a-4596-ba2b-3a29184b1ba6 finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:33:00.831976 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-53746842-8e88-4fd0-9654-94ec310492e7 tempest-VolumesBackupsAdminTest-889997415 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:33:00.874750 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-53746842-8e88-4fd0-9654-94ec310492e7 tempest-VolumesBackupsAdminTest-889997415 None] Created reservations ['64388315-48b0-4dd9-aa82-99e36ad1713f', '5e11f322-30a7-40d3-8e9f-cf3f3aa3233a'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:33:00.906432 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-53746842-8e88-4fd0-9654-94ec310492e7 tempest-VolumesBackupsAdminTest-889997415 None] Delete backup finished, backup eb4b86e5-8c1a-4596-ba2b-3a29184b1ba6 deleted. Jul 05 03:33:01.622525 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-9adb7a54-06fa-4f40-bce6-8730a7540943 tempest-VolumesBackupsAdminTest-1605990610 None] Delete backup started, backup: 94264060-4c36-41e2-b8bf-17049e555120. Jul 05 03:33:01.625256 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-9adb7a54-06fa-4f40-bce6-8730a7540943 tempest-VolumesBackupsAdminTest-1605990610 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_b4ae15bee4f8457eb9df47225969a6d0 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:33:01.627816 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-9adb7a54-06fa-4f40-bce6-8730a7540943 tempest-VolumesBackupsAdminTest-1605990610 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:33:01.627816 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9adb7a54-06fa-4f40-bce6-8730a7540943 tempest-VolumesBackupsAdminTest-1605990610 None] delete started, backup: 94264060-4c36-41e2-b8bf-17049e555120, container: tempest-volumesbackupsadmintest-backup-container-1905781052, prefix: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:33:01.677477 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9adb7a54-06fa-4f40-bce6-8730a7540943 tempest-VolumesBackupsAdminTest-1605990610 None] generated object list: ['volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00001', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00002', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00003', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00004', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00005', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00006', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00007', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00008', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00009', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00010', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00011', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00012', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00013', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00014', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00015', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00016', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00017', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00018', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00019', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00020', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00021', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120_metadata', 'volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:33:01.701359 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9adb7a54-06fa-4f40-bce6-8730a7540943 tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00001 in container: tempest-volumesbackupsadmintest-backup-container-1905781052. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:01.723118 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9adb7a54-06fa-4f40-bce6-8730a7540943 tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00002 in container: tempest-volumesbackupsadmintest-backup-container-1905781052. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:01.748169 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9adb7a54-06fa-4f40-bce6-8730a7540943 tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00003 in container: tempest-volumesbackupsadmintest-backup-container-1905781052. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:01.771845 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9adb7a54-06fa-4f40-bce6-8730a7540943 tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00004 in container: tempest-volumesbackupsadmintest-backup-container-1905781052. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:01.797367 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9adb7a54-06fa-4f40-bce6-8730a7540943 tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00005 in container: tempest-volumesbackupsadmintest-backup-container-1905781052. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:01.823936 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9adb7a54-06fa-4f40-bce6-8730a7540943 tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00006 in container: tempest-volumesbackupsadmintest-backup-container-1905781052. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:01.850230 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9adb7a54-06fa-4f40-bce6-8730a7540943 tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00007 in container: tempest-volumesbackupsadmintest-backup-container-1905781052. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:01.872696 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9adb7a54-06fa-4f40-bce6-8730a7540943 tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00008 in container: tempest-volumesbackupsadmintest-backup-container-1905781052. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:01.904524 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9adb7a54-06fa-4f40-bce6-8730a7540943 tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00009 in container: tempest-volumesbackupsadmintest-backup-container-1905781052. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:01.928692 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9adb7a54-06fa-4f40-bce6-8730a7540943 tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00010 in container: tempest-volumesbackupsadmintest-backup-container-1905781052. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:01.955524 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9adb7a54-06fa-4f40-bce6-8730a7540943 tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00011 in container: tempest-volumesbackupsadmintest-backup-container-1905781052. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:01.986028 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9adb7a54-06fa-4f40-bce6-8730a7540943 tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00012 in container: tempest-volumesbackupsadmintest-backup-container-1905781052. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:02.010290 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9adb7a54-06fa-4f40-bce6-8730a7540943 tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00013 in container: tempest-volumesbackupsadmintest-backup-container-1905781052. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:02.031226 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9adb7a54-06fa-4f40-bce6-8730a7540943 tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00014 in container: tempest-volumesbackupsadmintest-backup-container-1905781052. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:02.051614 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9adb7a54-06fa-4f40-bce6-8730a7540943 tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00015 in container: tempest-volumesbackupsadmintest-backup-container-1905781052. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:02.074453 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9adb7a54-06fa-4f40-bce6-8730a7540943 tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00016 in container: tempest-volumesbackupsadmintest-backup-container-1905781052. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:02.096086 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9adb7a54-06fa-4f40-bce6-8730a7540943 tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00017 in container: tempest-volumesbackupsadmintest-backup-container-1905781052. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:02.117317 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9adb7a54-06fa-4f40-bce6-8730a7540943 tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00018 in container: tempest-volumesbackupsadmintest-backup-container-1905781052. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:02.153310 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9adb7a54-06fa-4f40-bce6-8730a7540943 tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00019 in container: tempest-volumesbackupsadmintest-backup-container-1905781052. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:02.178417 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9adb7a54-06fa-4f40-bce6-8730a7540943 tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00020 in container: tempest-volumesbackupsadmintest-backup-container-1905781052. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:02.205320 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9adb7a54-06fa-4f40-bce6-8730a7540943 tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120-00021 in container: tempest-volumesbackupsadmintest-backup-container-1905781052. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:02.233372 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9adb7a54-06fa-4f40-bce6-8730a7540943 tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120_metadata in container: tempest-volumesbackupsadmintest-backup-container-1905781052. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:02.259540 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9adb7a54-06fa-4f40-bce6-8730a7540943 tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_1c460f68-e03d-4cab-859a-b76d6d41acb1/20260705033228/az_nova_backup_94264060-4c36-41e2-b8bf-17049e555120_sha256file in container: tempest-volumesbackupsadmintest-backup-container-1905781052. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:02.259838 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9adb7a54-06fa-4f40-bce6-8730a7540943 tempest-VolumesBackupsAdminTest-1605990610 None] delete 94264060-4c36-41e2-b8bf-17049e555120 finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:33:02.304658 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-9adb7a54-06fa-4f40-bce6-8730a7540943 tempest-VolumesBackupsAdminTest-1605990610 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:33:02.318819 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-9adb7a54-06fa-4f40-bce6-8730a7540943 tempest-VolumesBackupsAdminTest-1605990610 None] Created reservations ['bbab9261-01b8-43f0-b484-d28bab3a1732', 'f9a578c7-db46-4190-85ac-1ce1961023dd'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:33:02.342447 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-9adb7a54-06fa-4f40-bce6-8730a7540943 tempest-VolumesBackupsAdminTest-1605990610 None] Delete backup finished, backup 94264060-4c36-41e2-b8bf-17049e555120 deleted. Jul 05 03:33:05.311098 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Create backup started, backup: 715d19a9-3174-4b0b-8ed2-34b93ddcdb9c volume: a3578d9e-0798-472d-83d5-21c3b65e59ea. Jul 05 03:33:05.316821 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupsadmintest-backup-container-362837331',created_at=2026-07-05T03:33:05Z,data_timestamp=2026-07-05T03:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-1698046419',encryption_key_id=None,fail_reason=None,host='np0000004562',id=715d19a9-3174-4b0b-8ed2-34b93ddcdb9c,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='b4ae15bee4f8457eb9df47225969a6d0',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='29d98430fbd943c3ae6d1b02a0f64fe3',volume_id=a3578d9e-0798-472d-83d5-21c3b65e59ea) Jul 05 03:33:05.338522 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_b4ae15bee4f8457eb9df47225969a6d0 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:33:05.338728 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:33:05.339036 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:33:05.349785 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:33:05.370208 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:05.380950 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:33:05.381234 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:33:05.389074 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:33:05.390406 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe1d:9945', 'fe80::20f3:8bff:fea8:962c', 'fe80::f816:3eff:fef9:d246', 'fe80::b410:eeff:fe9d:3572', 'fe80::f816:3eff:fe0a:c8e6', 'fe80::f816:3eff:fe73:41ed', 'fe80::f816:3eff:fe85:320d', 'fe80::3847:67ff:fe92:197', 'fe80::f816:3eff:fe19:b53', 'fe80::f816:3eff:fece:4a0c', 'fe80::4003:aff:fe73:5fc', 'fe80::f816:3eff:feb8:5256', 'fe80::4477:57ff:fecf:c6f0', 'fe80::f816:3eff:fea0:5c94'] Jul 05 03:33:05.390700 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:33:05.391008 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:33:05.391312 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] <== get_connector_properties: return (51ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:33:05.896872 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:33:05.897391 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a3578d9e-0798-472d-83d5-21c3b65e59ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a3578d9e-0798-472d-83d5-21c3b65e59ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:33:05.897610 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:33:05.898238 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:33:05.898508 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a3578d9e-0798-472d-83d5-21c3b65e59ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a3578d9e-0798-472d-83d5-21c3b65e59ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:33:05.913185 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a3578d9e-0798-472d-83d5-21c3b65e59ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:33:05.913775 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a3578d9e-0798-472d-83d5-21c3b65e59ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:33:05.914089 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:33:05.937048 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:33:05.937048 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:05.944534 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a3578d9e-0798-472d-83d5-21c3b65e59ea] added Jul 05 03:33:05.944534 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:33:05.944534 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:33:05.944534 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:33:05.944534 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:33:05.944534 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:33:05.944534 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:05.944534 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:33:05.945309 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0307(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:33:05.945309 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:33:06.247115 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:33:06.279286 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Create backup started, backup: f7979613-42ec-4eb4-9408-15fb38fad3ab volume: 5d238629-e10e-4d32-bace-5d4ba2692208 snapshot: 814217a1-11be-4c7e-b416-bff81681198a. Jul 05 03:33:06.286541 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumessnapshottestjson-backup-container-369271586',created_at=2026-07-05T03:33:06Z,data_timestamp=2026-07-05T03:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Backup-661222186',encryption_key_id=None,fail_reason=None,host='np0000004562',id=f7979613-42ec-4eb4-9408-15fb38fad3ab,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='d501ff4cdb7245fba675291a98ccb926',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id='814217a1-11be-4c7e-b416-bff81681198a',status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='43de71339d8b4e3c957a35852444cf52',volume_id=5d238629-e10e-4d32-bace-5d4ba2692208) Jul 05 03:33:06.368202 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_d501ff4cdb7245fba675291a98ccb926 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:33:06.368812 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:33:06.368812 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:33:06.380124 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:33:06.400092 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:06.413732 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:33:06.414110 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:33:06.421967 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:33:06.423676 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe1d:9945', 'fe80::20f3:8bff:fea8:962c', 'fe80::f816:3eff:fef9:d246', 'fe80::b410:eeff:fe9d:3572', 'fe80::f816:3eff:fe0a:c8e6', 'fe80::f816:3eff:fe73:41ed', 'fe80::f816:3eff:fe85:320d', 'fe80::3847:67ff:fe92:197', 'fe80::f816:3eff:fe19:b53', 'fe80::f816:3eff:fece:4a0c', 'fe80::4003:aff:fe73:5fc', 'fe80::f816:3eff:feb8:5256', 'fe80::4477:57ff:fecf:c6f0', 'fe80::f816:3eff:fea0:5c94'] Jul 05 03:33:06.423968 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:33:06.424137 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:33:06.424458 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] <== get_connector_properties: return (55ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:33:06.929185 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:33:06.929606 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-130aac75-4453-4c43-a0be-0fa16f08ec7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '130aac75-4453-4c43-a0be-0fa16f08ec7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:33:06.929840 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:33:06.946956 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-a3578d9e-0798-472d-83d5-21c3b65e59ea Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:33:06.957833 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:06.969083 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:06.982791 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:06.982791 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:06.982791 np0000004562 cinder-backup[101413]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:06.982791 np0000004562 cinder-backup[101413]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:06.982791 np0000004562 cinder-backup[101413]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:06.982791 np0000004562 cinder-backup[101413]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:06.982791 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:33:06.983114 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:06.983114 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:06.983114 np0000004562 cinder-backup[101413]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:06.983114 np0000004562 cinder-backup[101413]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:06.983114 np0000004562 cinder-backup[101413]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:06.983114 np0000004562 cinder-backup[101413]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:06.983114 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:33:07.026021 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a3578d9e-0798-472d-83d5-21c3b65e59ea, portal: 192.168.40.100,3260] Jul 05 03:33:07.026021 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a3578d9e-0798-472d-83d5-21c3b65e59ea, portal: 192.168.40.100,3260] successful. Jul 05 03:33:07.026021 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:07.038248 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:07.052029 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:07.052029 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:07.052029 np0000004562 cinder-backup[101413]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:07.052029 np0000004562 cinder-backup[101413]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:07.052029 np0000004562 cinder-backup[101413]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:07.052029 np0000004562 cinder-backup[101413]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:07.052029 np0000004562 cinder-backup[101413]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3578d9e-0798-472d-83d5-21c3b65e59ea (non-flash) Jul 05 03:33:07.052029 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:33:07.054228 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:07.054228 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:07.054228 np0000004562 cinder-backup[101413]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:07.054228 np0000004562 cinder-backup[101413]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:07.054228 np0000004562 cinder-backup[101413]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:07.054228 np0000004562 cinder-backup[101413]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:07.054228 np0000004562 cinder-backup[101413]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3578d9e-0798-472d-83d5-21c3b65e59ea (non-flash) Jul 05 03:33:07.054228 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:33:07.054228 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a3578d9e-0798-472d-83d5-21c3b65e59ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.139s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:33:07.054228 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:33:07.054228 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] HCTL ('13', '-', '-', 0) found on session 35 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:33:07.054228 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Scanning host 13 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:33:07.078812 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Searching for a device in session 35 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:33:07.078812 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a3578d9e-0798-472d-83d5-21c3b65e59ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a3578d9e-0798-472d-83d5-21c3b65e59ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:33:08.080635 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.180s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:33:08.080635 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] <== connect_volume: return (2180ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445798958', 'path': '/dev/sdh'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:33:08.080635 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:08.086440 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.155s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:33:08.087098 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-130aac75-4453-4c43-a0be-0fa16f08ec7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '130aac75-4453-4c43-a0be-0fa16f08ec7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:33:08.097310 np0000004562 sudo[119184]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh Jul 05 03:33:08.098100 np0000004562 sudo[119184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:33:08.100574 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-130aac75-4453-4c43-a0be-0fa16f08ec7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:33:08.100574 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-130aac75-4453-4c43-a0be-0fa16f08ec7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:33:08.100574 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:33:08.113640 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:33:08.113640 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:08.126770 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-130aac75-4453-4c43-a0be-0fa16f08ec7c] added Jul 05 03:33:08.126770 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:33:08.126770 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:33:08.126770 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:33:08.126770 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:33:08.126770 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:33:08.126770 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:08.128567 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:33:08.128567 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0276(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:33:08.128567 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:33:08.471597 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh" returned: 0 in 0.391s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:08.462636 np0000004562 sudo[119184]: pam_unix(sudo:session): session closed for user root Jul 05 03:33:08.524164 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:33:08.529482 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] _create_container started, container: tempest-volumesbackupsadmintest-backup-container-362837331,backup: 715d19a9-3174-4b0b-8ed2-34b93ddcdb9c. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:33:08.575873 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] generate_object_name_prefix: volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:33:08.580602 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] starting backup of volume: a3578d9e-0798-472d-83d5-21c3b65e59ea, volume size: 1073741824, object names prefix volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:33:08.804178 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:09.058925 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:09.058925 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:09.129397 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-130aac75-4453-4c43-a0be-0fa16f08ec7c Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:33:09.140051 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:09.151610 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:09.164050 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:09.164050 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:09.164050 np0000004562 cinder-backup[101413]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:09.164050 np0000004562 cinder-backup[101413]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:09.164050 np0000004562 cinder-backup[101413]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:09.164050 np0000004562 cinder-backup[101413]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:09.164050 np0000004562 cinder-backup[101413]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3578d9e-0798-472d-83d5-21c3b65e59ea (non-flash) Jul 05 03:33:09.164050 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:33:09.164050 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:09.164050 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:09.164050 np0000004562 cinder-backup[101413]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:09.164050 np0000004562 cinder-backup[101413]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:09.164050 np0000004562 cinder-backup[101413]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:09.164050 np0000004562 cinder-backup[101413]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:09.164050 np0000004562 cinder-backup[101413]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3578d9e-0798-472d-83d5-21c3b65e59ea (non-flash) Jul 05 03:33:09.164050 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:33:09.169594 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:09.169851 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:09.201077 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-130aac75-4453-4c43-a0be-0fa16f08ec7c, portal: 192.168.40.100,3260] Jul 05 03:33:09.201077 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-130aac75-4453-4c43-a0be-0fa16f08ec7c, portal: 192.168.40.100,3260] successful. Jul 05 03:33:09.201077 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:09.211346 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:09.226993 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:09.226993 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:09.226993 np0000004562 cinder-backup[101413]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:09.226993 np0000004562 cinder-backup[101413]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:09.226993 np0000004562 cinder-backup[101413]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:09.226993 np0000004562 cinder-backup[101413]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:09.226993 np0000004562 cinder-backup[101413]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3578d9e-0798-472d-83d5-21c3b65e59ea (non-flash) Jul 05 03:33:09.226993 np0000004562 cinder-backup[101413]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-130aac75-4453-4c43-a0be-0fa16f08ec7c (non-flash) Jul 05 03:33:09.226993 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:33:09.226993 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:09.226993 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:09.226993 np0000004562 cinder-backup[101413]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:09.226993 np0000004562 cinder-backup[101413]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:09.226993 np0000004562 cinder-backup[101413]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:09.226993 np0000004562 cinder-backup[101413]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:09.226993 np0000004562 cinder-backup[101413]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3578d9e-0798-472d-83d5-21c3b65e59ea (non-flash) Jul 05 03:33:09.226993 np0000004562 cinder-backup[101413]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-130aac75-4453-4c43-a0be-0fa16f08ec7c (non-flash) Jul 05 03:33:09.226993 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:33:09.226993 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-130aac75-4453-4c43-a0be-0fa16f08ec7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.125s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:33:09.226993 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:33:09.226993 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] HCTL ('14', '-', '-', 0) found on session 36 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:33:09.226993 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Scanning host 14 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:33:09.250613 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Searching for a device in session 36 and hctl ['14', '*', '*', 0] yield: None {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:33:09.384175 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:09.636704 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:09.636903 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:09.740999 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:09.741182 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:09.974957 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:10.216446 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:10.216933 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:10.250480 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Searching for a device in session 36 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:33:10.250666 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-130aac75-4453-4c43-a0be-0fa16f08ec7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '130aac75-4453-4c43-a0be-0fa16f08ec7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:33:10.251298 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.166s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:33:10.251493 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] <== connect_volume: return (3321ms) {'type': 'block', 'scsi_wwn': '330000000c43096ca', 'path': '/dev/sdi'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:33:10.251855 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdi {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:10.268922 np0000004562 sudo[119245]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdi Jul 05 03:33:10.269535 np0000004562 sudo[119245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:33:10.324382 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:10.324382 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:10.519367 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:10.583964 np0000004562 sudo[119245]: pam_unix(sudo:session): session closed for user root Jul 05 03:33:10.586809 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdi" returned: 0 in 0.334s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:10.591531 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] _create_container started, container: tempest-volumessnapshottestjson-backup-container-369271586,backup: f7979613-42ec-4eb4-9408-15fb38fad3ab. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:33:10.704742 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] generate_object_name_prefix: volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:33:10.711933 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] starting backup of volume: 5d238629-e10e-4d32-bace-5d4ba2692208, volume size: 1073741824, object names prefix volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:33:10.773605 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:10.773605 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:10.893607 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:10.922003 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:10.922003 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:11.131360 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:11.139924 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:11.139924 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:11.252343 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] backup MD5 for volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:11.252343 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:11.386894 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:11.386894 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:11.457411 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:11.516699 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:11.517017 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:11.697187 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:11.729877 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:11.730317 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:11.746463 np0000004562 cinder-backup[101413]: DEBUG oslo_service.periodic_task [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:33:11.746463 np0000004562 cinder-backup[101413]: DEBUG cinder.manager [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Notifying Schedulers of capabilities ... {{(pid=101413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:33:11.838190 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] backup MD5 for volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:11.838397 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:11.973561 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:11.973978 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:12.080130 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:12.089339 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:12.089528 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:12.296585 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:12.330409 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:12.330631 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:12.438822 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] backup MD5 for volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:12.438822 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:12.551043 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:12.551211 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:12.675298 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:12.676420 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:12.676576 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:12.901387 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:12.947587 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:12.947789 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:13.065897 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] backup MD5 for volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:13.066088 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:13.147773 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:13.148654 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:13.270701 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:13.270922 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:13.282997 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:13.497364 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:13.541138 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:13.541326 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:13.654258 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] backup MD5 for volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:13.654698 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:13.766589 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:13.766828 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:13.883832 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:13.884018 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:13.908252 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:14.122483 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:14.180285 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:14.180445 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:14.285400 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] backup MD5 for volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:14.285667 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:14.392010 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:14.392758 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:14.502460 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:14.502947 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:14.512581 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:14.707876 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:14.798850 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:14.798850 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:14.907508 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] backup MD5 for volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:14.907724 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:14.989023 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:14.989023 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:15.103030 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:15.104317 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:15.131140 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:15.288398 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:15.392365 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:15.392365 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:15.504765 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] backup MD5 for volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:15.504765 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:15.556829 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:15.557546 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:15.673128 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:15.673514 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:15.776528 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:15.879320 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:16.025107 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:16.025284 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:16.139249 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:16.139417 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:16.194885 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] backup MD5 for volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:16.195114 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:16.197064 np0000004562 cinder-backup[101413]: DEBUG dbcounter [-] [101413] Writing DB stats cinder:SELECT=108,cinder:UPDATE=26,cinder:INSERT=5 {{(pid=101413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:33:16.250061 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:16.250342 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:16.492560 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:16.562491 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:16.757220 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:16.757388 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:16.818460 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:16.818609 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:16.863939 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] backup MD5 for volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:16.864152 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:16.956622 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:16.956622 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:17.091952 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:17.193083 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:17.377581 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:17.377581 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:17.484796 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:17.484964 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:17.507991 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] backup MD5 for volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:17.508241 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:17.595682 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:17.596228 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:17.745145 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:17.829409 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:17.999849 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:17.999976 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:18.080408 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:18.080741 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:18.115451 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] backup MD5 for volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:18.115668 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:18.196161 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:18.196304 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:18.402999 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:18.517207 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:18.691440 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:18.691440 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:18.767184 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:18.767184 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:18.805670 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] backup MD5 for volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:18.807208 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:18.900762 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:18.900938 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:19.093071 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:19.142602 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:19.347434 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:19.347593 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:19.395989 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:19.396151 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:19.458266 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] backup MD5 for volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:19.458487 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:19.502452 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:19.502680 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:19.734657 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:19.767345 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:19.980186 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:19.980310 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:20.018809 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:20.018964 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:20.094499 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] backup MD5 for volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:20.094499 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:20.134725 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:20.134899 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:20.397462 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:20.456058 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:20.670979 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:20.671164 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:20.734992 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:20.735416 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:20.794407 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] backup MD5 for volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:20.794407 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:20.846771 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:20.846771 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:21.007234 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:21.048490 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:21.130770 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:21.130902 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:21.198321 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] backup MD5 for volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:21.198496 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:21.206163 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:33:21.221317 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:33:21.221317 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:33:21.221317 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:33:21.221317 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:33:21.221317 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:33:21.221317 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] _write_sha256file started, container name: tempest-volumesbackupsadmintest-backup-container-362837331, sha256file filename: volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:33:21.303952 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:33:21.304591 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] _write_metadata started, container name: tempest-volumesbackupsadmintest-backup-container-362837331, metadata filename: volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:33:21.328188 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:21.328353 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:21.331080 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "715d19a9-3174-4b0b-8ed2-34b93ddcdb9c",\n "backup_name": "tempest-VolumesBackupsAdminTest-Backup-1698046419",\n "created_at": "2026-07-05 03:33:05+00:00",\n "objects": [\n {\n "volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "a3578d9e-0798-472d-83d5-21c3b65e59ea",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"a3578d9e-0798-472d-83d5-21c3b65e59ea\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"29d98430fbd943c3ae6d1b02a0f64fe3\\", \\"project_id\\": \\"b4ae15bee4f8457eb9df47225969a6d0\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:33:04.000000\\", \\"launched_at\\": \\"2026-07-05T03:33:04.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsAdminTest-Volume-1256562404\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:33:04.000000\\", \\"updated_at\\": \\"2026-07-05T03:33:05.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:33:21.340053 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] backup 715d19a9-3174-4b0b-8ed2-34b93ddcdb9c finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:33:21.467179 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:21.489227 np0000004562 sudo[119318]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh Jul 05 03:33:21.490111 np0000004562 sudo[119318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:33:21.550372 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] backup MD5 for volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:21.550515 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:21.801369 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:21.879251 np0000004562 sudo[119318]: pam_unix(sudo:session): session closed for user root Jul 05 03:33:21.883232 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh" returned: 0 in 0.414s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:21.883232 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a3578d9e-0798-472d-83d5-21c3b65e59ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a3578d9e-0798-472d-83d5-21c3b65e59ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445798958', 'path': '/dev/sdh'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:33:21.883232 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:33:21.883232 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:33:21.883771 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a3578d9e-0798-472d-83d5-21c3b65e59ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a3578d9e-0798-472d-83d5-21c3b65e59ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:33:21.897550 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:33:21.897550 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:33:21.897550 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:33:21.897550 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:33:21.897550 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:33:21.897550 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c Jul 05 03:33:21.897550 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:33:21.897550 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:33:21.897550 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:33:21.897550 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:33:21.897550 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-a3578d9e-0798-472d-83d5-21c3b65e59ea Jul 05 03:33:21.897550 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:33:21.897550 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:33:21.897550 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-130aac75-4453-4c43-a0be-0fa16f08ec7c Jul 05 03:33:21.897550 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:33:21.897550 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:33:21.897550 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 Jul 05 03:33:21.897550 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:33:21.897550 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:33:21.897550 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:33:21.897550 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:33:21.897550 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 Jul 05 03:33:21.897550 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:33:21.897550 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:33:21.897550 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:33:21.897550 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:33:21.897550 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:33:21.897550 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:33:21.897550 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:33:21.897550 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:33:21.897550 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:33:21.897550 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:33:21.897550 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a3578d9e-0798-472d-83d5-21c3b65e59ea', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:33:21.922677 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:21.922677 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:21.922677 np0000004562 cinder-backup[101413]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:21.922677 np0000004562 cinder-backup[101413]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:21.922677 np0000004562 cinder-backup[101413]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:21.922677 np0000004562 cinder-backup[101413]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:21.922677 np0000004562 cinder-backup[101413]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3578d9e-0798-472d-83d5-21c3b65e59ea (non-flash) Jul 05 03:33:21.922677 np0000004562 cinder-backup[101413]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-130aac75-4453-4c43-a0be-0fa16f08ec7c (non-flash) Jul 05 03:33:21.922677 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:33:21.923134 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:21.923134 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:21.923134 np0000004562 cinder-backup[101413]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:21.923134 np0000004562 cinder-backup[101413]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:21.923134 np0000004562 cinder-backup[101413]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:21.923134 np0000004562 cinder-backup[101413]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:21.923134 np0000004562 cinder-backup[101413]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3578d9e-0798-472d-83d5-21c3b65e59ea (non-flash) Jul 05 03:33:21.923134 np0000004562 cinder-backup[101413]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-130aac75-4453-4c43-a0be-0fa16f08ec7c (non-flash) Jul 05 03:33:21.923134 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:33:21.923134 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', '26'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a3578d9e-0798-472d-83d5-21c3b65e59ea', '35'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-130aac75-4453-4c43-a0be-0fa16f08ec7c', '36')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:33:21.923134 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a3578d9e-0798-472d-83d5-21c3b65e59ea, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a3578d9e-0798-472d-83d5-21c3b65e59ea', '35')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:33:21.924175 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Resulting device map defaultdict(. at 0x72a48e955940>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a3578d9e-0798-472d-83d5-21c3b65e59ea'): ({'sdh'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:33:21.924378 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Removing single pathed devices sdh {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:33:21.935354 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Flushing IO for device /dev/sdh {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:33:21.944046 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:33:21.993025 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Checking to see if SCSI volumes sdh have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:33:21.993171 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] SCSI volumes sdh have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:33:21.994269 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Checking to see if device paths {'sdh'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:33:22.003688 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Device paths {'sdh'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:33:22.003989 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a3578d9e-0798-472d-83d5-21c3b65e59ea')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:33:22.013543 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:22.051126 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2023-03.storpool.com:os--volume-a3578d9e-0798-472d-83d5-21c3b65e59ea, portal: 192.168.40.100,3260] Jul 05 03:33:22.051126 np0000004562 cinder-backup[101413]: Logout of [sid: 35, target: iqn.2023-03.storpool.com:os--volume-a3578d9e-0798-472d-83d5-21c3b65e59ea, portal: 192.168.40.100,3260] successful. Jul 05 03:33:22.051126 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:22.060519 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:22.060904 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:22.072165 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:22.072462 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.190s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:33:22.072684 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] <== disconnect_volume: return (190ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:33:22.167458 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] backup MD5 for volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:22.167634 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:22.357014 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:22.602091 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:22.602285 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:22.709676 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] backup MD5 for volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:22.709825 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:22.888538 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:23.095692 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-12a2437f-1a0f-445c-80d6-c44d50a34752 tempest-VolumesBackupsAdminTest-1605990610 None] Create backup finished. backup: 715d19a9-3174-4b0b-8ed2-34b93ddcdb9c. Jul 05 03:33:23.138273 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:23.138406 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:23.237806 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] backup MD5 for volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:23.237958 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:23.331025 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:33:23.446125 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:33:23.446323 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:33:23.507146 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] backup MD5 for volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:33:23.507359 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:33:23.513765 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:33:23.519502 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:33:23.519749 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:33:23.523500 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:33:23.523640 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:33:23.526399 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:33:23.526606 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] _write_sha256file started, container name: tempest-volumessnapshottestjson-backup-container-369271586, sha256file filename: volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:33:23.577739 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:33:23.578679 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] _write_metadata started, container name: tempest-volumessnapshottestjson-backup-container-369271586, metadata filename: volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:33:23.600197 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "f7979613-42ec-4eb4-9408-15fb38fad3ab",\n "backup_name": "tempest-VolumesSnapshotTestJSON-Backup-661222186",\n "created_at": "2026-07-05 03:33:06+00:00",\n "objects": [\n {\n "volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "5d238629-e10e-4d32-bace-5d4ba2692208",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"5d238629-e10e-4d32-bace-5d4ba2692208\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"43de71339d8b4e3c957a35852444cf52\\", \\"project_id\\": \\"d501ff4cdb7245fba675291a98ccb926\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"available\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:33:04.000000\\", \\"launched_at\\": \\"2026-07-05T03:33:04.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesSnapshotTestJSON-Volume-560261779\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": null, \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:33:04.000000\\", \\"updated_at\\": \\"2026-07-05T03:33:04.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:33:23.604377 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] backup f7979613-42ec-4eb4-9408-15fb38fad3ab finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:33:23.727009 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdi {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:33:23.742653 np0000004562 sudo[119370]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdi Jul 05 03:33:23.743300 np0000004562 sudo[119370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:33:23.875663 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-3ccac2f4-28df-4df7-a0ab-86ca78b53173 tempest-VolumesBackupsAdminTest-889997415 None] Reset backup status started, backup_id: 715d19a9-3174-4b0b-8ed2-34b93ddcdb9c, status: error. Jul 05 03:33:23.875938 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-3ccac2f4-28df-4df7-a0ab-86ca78b53173 tempest-VolumesBackupsAdminTest-889997415 None] Backup service: cinder.backup.drivers.swift.SwiftBackupDriver. Jul 05 03:33:23.923727 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-e8078d5e-7630-4873-8985-0300aa2bfa7f tempest-VolumesBackupsAdminTest-1605990610 None] Delete backup started, backup: 715d19a9-3174-4b0b-8ed2-34b93ddcdb9c. Jul 05 03:33:23.927046 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-e8078d5e-7630-4873-8985-0300aa2bfa7f tempest-VolumesBackupsAdminTest-1605990610 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_b4ae15bee4f8457eb9df47225969a6d0 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:33:23.927242 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-e8078d5e-7630-4873-8985-0300aa2bfa7f tempest-VolumesBackupsAdminTest-1605990610 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:33:23.927404 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8078d5e-7630-4873-8985-0300aa2bfa7f tempest-VolumesBackupsAdminTest-1605990610 None] delete started, backup: 715d19a9-3174-4b0b-8ed2-34b93ddcdb9c, container: tempest-volumesbackupsadmintest-backup-container-362837331, prefix: volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:33:23.970221 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8078d5e-7630-4873-8985-0300aa2bfa7f tempest-VolumesBackupsAdminTest-1605990610 None] generated object list: ['volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00001', 'volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00002', 'volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00003', 'volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00004', 'volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00005', 'volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00006', 'volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00007', 'volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00008', 'volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00009', 'volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00010', 'volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00011', 'volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00012', 'volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00013', 'volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00014', 'volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00015', 'volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00016', 'volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00017', 'volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00018', 'volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00019', 'volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00020', 'volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00021', 'volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c_metadata', 'volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:33:23.989279 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8078d5e-7630-4873-8985-0300aa2bfa7f tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00001 in container: tempest-volumesbackupsadmintest-backup-container-362837331. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:24.010354 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8078d5e-7630-4873-8985-0300aa2bfa7f tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00002 in container: tempest-volumesbackupsadmintest-backup-container-362837331. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:24.035682 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8078d5e-7630-4873-8985-0300aa2bfa7f tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00003 in container: tempest-volumesbackupsadmintest-backup-container-362837331. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:24.056468 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8078d5e-7630-4873-8985-0300aa2bfa7f tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00004 in container: tempest-volumesbackupsadmintest-backup-container-362837331. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:24.062804 np0000004562 sudo[119370]: pam_unix(sudo:session): session closed for user root Jul 05 03:33:24.064471 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdi" returned: 0 in 0.338s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:33:24.065108 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-130aac75-4453-4c43-a0be-0fa16f08ec7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '130aac75-4453-4c43-a0be-0fa16f08ec7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000c43096ca', 'path': '/dev/sdi'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:33:24.065340 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:33:24.065850 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:33:24.066196 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-130aac75-4453-4c43-a0be-0fa16f08ec7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '130aac75-4453-4c43-a0be-0fa16f08ec7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:33:24.078431 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:33:24.078431 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:33:24.078431 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:33:24.078431 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:33:24.078431 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:33:24.078431 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c Jul 05 03:33:24.078431 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:33:24.078431 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:33:24.078431 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:33:24.078431 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:33:24.078431 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-130aac75-4453-4c43-a0be-0fa16f08ec7c Jul 05 03:33:24.078431 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:33:24.078431 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:33:24.078431 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 Jul 05 03:33:24.078431 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:33:24.078431 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:33:24.078431 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:33:24.078431 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:33:24.078431 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 Jul 05 03:33:24.078431 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:33:24.078431 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:33:24.078431 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:33:24.078431 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:33:24.078431 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:33:24.078431 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:33:24.078431 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:33:24.079032 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:33:24.079032 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:33:24.079032 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:33:24.079115 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-130aac75-4453-4c43-a0be-0fa16f08ec7c', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:33:24.080096 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8078d5e-7630-4873-8985-0300aa2bfa7f tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00005 in container: tempest-volumesbackupsadmintest-backup-container-362837331. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:24.101540 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8078d5e-7630-4873-8985-0300aa2bfa7f tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00006 in container: tempest-volumesbackupsadmintest-backup-container-362837331. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:24.105043 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:24.105043 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:24.105043 np0000004562 cinder-backup[101413]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:24.105043 np0000004562 cinder-backup[101413]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:24.105043 np0000004562 cinder-backup[101413]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:24.105043 np0000004562 cinder-backup[101413]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:24.105043 np0000004562 cinder-backup[101413]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-130aac75-4453-4c43-a0be-0fa16f08ec7c (non-flash) Jul 05 03:33:24.105043 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:33:24.105358 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:24.105358 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:33:24.105358 np0000004562 cinder-backup[101413]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:24.105358 np0000004562 cinder-backup[101413]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431 (non-flash) Jul 05 03:33:24.105358 np0000004562 cinder-backup[101413]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:24.105358 np0000004562 cinder-backup[101413]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671 (non-flash) Jul 05 03:33:24.105358 np0000004562 cinder-backup[101413]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-130aac75-4453-4c43-a0be-0fa16f08ec7c (non-flash) Jul 05 03:33:24.105358 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:33:24.105918 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', '26'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edafe60a-44d7-43ef-983e-c5e6a199b431', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c04faaf-51aa-4375-9185-8fe3984e7671', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-130aac75-4453-4c43-a0be-0fa16f08ec7c', '36')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:33:24.105918 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-130aac75-4453-4c43-a0be-0fa16f08ec7c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-130aac75-4453-4c43-a0be-0fa16f08ec7c', '36')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:33:24.106531 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Resulting device map defaultdict(. at 0x72a48e9cca40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-130aac75-4453-4c43-a0be-0fa16f08ec7c'): ({'sdi'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:33:24.106765 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Removing single pathed devices sdi {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:33:24.119324 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Flushing IO for device /dev/sdi {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:33:24.124436 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8078d5e-7630-4873-8985-0300aa2bfa7f tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00007 in container: tempest-volumesbackupsadmintest-backup-container-362837331. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:24.127791 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:33:24.142973 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8078d5e-7630-4873-8985-0300aa2bfa7f tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00008 in container: tempest-volumesbackupsadmintest-backup-container-362837331. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:24.171578 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8078d5e-7630-4873-8985-0300aa2bfa7f tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00009 in container: tempest-volumesbackupsadmintest-backup-container-362837331. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:24.174525 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Checking to see if SCSI volumes sdi have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:33:24.174746 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] SCSI volumes sdi have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:33:24.175676 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Checking to see if device paths {'sdi'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:33:24.186057 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Device paths {'sdi'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:33:24.186281 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-130aac75-4453-4c43-a0be-0fa16f08ec7c')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:33:24.192595 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8078d5e-7630-4873-8985-0300aa2bfa7f tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00010 in container: tempest-volumesbackupsadmintest-backup-container-362837331. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:24.198512 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:24.215765 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8078d5e-7630-4873-8985-0300aa2bfa7f tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00011 in container: tempest-volumesbackupsadmintest-backup-container-362837331. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:24.235608 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2023-03.storpool.com:os--volume-130aac75-4453-4c43-a0be-0fa16f08ec7c, portal: 192.168.40.100,3260] Jul 05 03:33:24.235608 np0000004562 cinder-backup[101413]: Logout of [sid: 36, target: iqn.2023-03.storpool.com:os--volume-130aac75-4453-4c43-a0be-0fa16f08ec7c, portal: 192.168.40.100,3260] successful. Jul 05 03:33:24.235608 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:24.240784 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8078d5e-7630-4873-8985-0300aa2bfa7f tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00012 in container: tempest-volumesbackupsadmintest-backup-container-362837331. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:24.257137 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:33:24.257467 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.192s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:33:24.258364 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] <== disconnect_volume: return (191ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:33:24.278083 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8078d5e-7630-4873-8985-0300aa2bfa7f tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00013 in container: tempest-volumesbackupsadmintest-backup-container-362837331. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:24.306625 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8078d5e-7630-4873-8985-0300aa2bfa7f tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00014 in container: tempest-volumesbackupsadmintest-backup-container-362837331. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:24.331563 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8078d5e-7630-4873-8985-0300aa2bfa7f tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00015 in container: tempest-volumesbackupsadmintest-backup-container-362837331. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:24.366167 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8078d5e-7630-4873-8985-0300aa2bfa7f tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00016 in container: tempest-volumesbackupsadmintest-backup-container-362837331. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:24.393480 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8078d5e-7630-4873-8985-0300aa2bfa7f tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00017 in container: tempest-volumesbackupsadmintest-backup-container-362837331. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:24.413379 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8078d5e-7630-4873-8985-0300aa2bfa7f tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00018 in container: tempest-volumesbackupsadmintest-backup-container-362837331. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:24.432600 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8078d5e-7630-4873-8985-0300aa2bfa7f tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00019 in container: tempest-volumesbackupsadmintest-backup-container-362837331. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:24.462919 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8078d5e-7630-4873-8985-0300aa2bfa7f tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00020 in container: tempest-volumesbackupsadmintest-backup-container-362837331. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:24.484608 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8078d5e-7630-4873-8985-0300aa2bfa7f tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c-00021 in container: tempest-volumesbackupsadmintest-backup-container-362837331. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:24.506120 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8078d5e-7630-4873-8985-0300aa2bfa7f tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c_metadata in container: tempest-volumesbackupsadmintest-backup-container-362837331. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:24.528791 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8078d5e-7630-4873-8985-0300aa2bfa7f tempest-VolumesBackupsAdminTest-1605990610 None] deleted object: volume_a3578d9e-0798-472d-83d5-21c3b65e59ea/20260705033308/az_nova_backup_715d19a9-3174-4b0b-8ed2-34b93ddcdb9c_sha256file in container: tempest-volumesbackupsadmintest-backup-container-362837331. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:24.529033 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8078d5e-7630-4873-8985-0300aa2bfa7f tempest-VolumesBackupsAdminTest-1605990610 None] delete 715d19a9-3174-4b0b-8ed2-34b93ddcdb9c finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:33:24.568203 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-e8078d5e-7630-4873-8985-0300aa2bfa7f tempest-VolumesBackupsAdminTest-1605990610 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:33:24.583956 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-e8078d5e-7630-4873-8985-0300aa2bfa7f tempest-VolumesBackupsAdminTest-1605990610 None] Created reservations ['0980876b-43e0-4a0a-b5e0-9db0ff8c6428', '872cfbf5-5add-44ac-84ff-179295994102'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:33:24.598556 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-e8078d5e-7630-4873-8985-0300aa2bfa7f tempest-VolumesBackupsAdminTest-1605990610 None] Delete backup finished, backup 715d19a9-3174-4b0b-8ed2-34b93ddcdb9c deleted. Jul 05 03:33:25.316333 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-13028c3f-f748-4a5f-a03a-900d781d69a4 tempest-VolumesSnapshotTestJSON-1023273812 None] Create backup finished. backup: f7979613-42ec-4eb4-9408-15fb38fad3ab. Jul 05 03:33:25.781075 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-9fc89c92-0670-48fe-bc04-53204f346370 tempest-VolumesSnapshotTestJSON-1023273812 None] Delete backup started, backup: f7979613-42ec-4eb4-9408-15fb38fad3ab. Jul 05 03:33:25.783583 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-9fc89c92-0670-48fe-bc04-53204f346370 tempest-VolumesSnapshotTestJSON-1023273812 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_d501ff4cdb7245fba675291a98ccb926 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:33:25.783785 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-9fc89c92-0670-48fe-bc04-53204f346370 tempest-VolumesSnapshotTestJSON-1023273812 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:33:25.783919 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9fc89c92-0670-48fe-bc04-53204f346370 tempest-VolumesSnapshotTestJSON-1023273812 None] delete started, backup: f7979613-42ec-4eb4-9408-15fb38fad3ab, container: tempest-volumessnapshottestjson-backup-container-369271586, prefix: volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:33:25.838995 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9fc89c92-0670-48fe-bc04-53204f346370 tempest-VolumesSnapshotTestJSON-1023273812 None] generated object list: ['volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00001', 'volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00002', 'volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00003', 'volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00004', 'volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00005', 'volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00006', 'volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00007', 'volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00008', 'volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00009', 'volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00010', 'volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00011', 'volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00012', 'volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00013', 'volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00014', 'volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00015', 'volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00016', 'volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00017', 'volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00018', 'volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00019', 'volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00020', 'volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00021', 'volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab_metadata', 'volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:33:25.857221 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9fc89c92-0670-48fe-bc04-53204f346370 tempest-VolumesSnapshotTestJSON-1023273812 None] deleted object: volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00001 in container: tempest-volumessnapshottestjson-backup-container-369271586. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:25.883725 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9fc89c92-0670-48fe-bc04-53204f346370 tempest-VolumesSnapshotTestJSON-1023273812 None] deleted object: volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00002 in container: tempest-volumessnapshottestjson-backup-container-369271586. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:25.906485 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9fc89c92-0670-48fe-bc04-53204f346370 tempest-VolumesSnapshotTestJSON-1023273812 None] deleted object: volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00003 in container: tempest-volumessnapshottestjson-backup-container-369271586. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:25.935487 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9fc89c92-0670-48fe-bc04-53204f346370 tempest-VolumesSnapshotTestJSON-1023273812 None] deleted object: volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00004 in container: tempest-volumessnapshottestjson-backup-container-369271586. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:25.959272 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9fc89c92-0670-48fe-bc04-53204f346370 tempest-VolumesSnapshotTestJSON-1023273812 None] deleted object: volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00005 in container: tempest-volumessnapshottestjson-backup-container-369271586. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:25.983617 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9fc89c92-0670-48fe-bc04-53204f346370 tempest-VolumesSnapshotTestJSON-1023273812 None] deleted object: volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00006 in container: tempest-volumessnapshottestjson-backup-container-369271586. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:26.003892 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9fc89c92-0670-48fe-bc04-53204f346370 tempest-VolumesSnapshotTestJSON-1023273812 None] deleted object: volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00007 in container: tempest-volumessnapshottestjson-backup-container-369271586. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:26.030468 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9fc89c92-0670-48fe-bc04-53204f346370 tempest-VolumesSnapshotTestJSON-1023273812 None] deleted object: volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00008 in container: tempest-volumessnapshottestjson-backup-container-369271586. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:26.053332 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9fc89c92-0670-48fe-bc04-53204f346370 tempest-VolumesSnapshotTestJSON-1023273812 None] deleted object: volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00009 in container: tempest-volumessnapshottestjson-backup-container-369271586. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:26.086056 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9fc89c92-0670-48fe-bc04-53204f346370 tempest-VolumesSnapshotTestJSON-1023273812 None] deleted object: volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00010 in container: tempest-volumessnapshottestjson-backup-container-369271586. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:26.106699 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9fc89c92-0670-48fe-bc04-53204f346370 tempest-VolumesSnapshotTestJSON-1023273812 None] deleted object: volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00011 in container: tempest-volumessnapshottestjson-backup-container-369271586. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:26.126031 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9fc89c92-0670-48fe-bc04-53204f346370 tempest-VolumesSnapshotTestJSON-1023273812 None] deleted object: volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00012 in container: tempest-volumessnapshottestjson-backup-container-369271586. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:26.155252 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9fc89c92-0670-48fe-bc04-53204f346370 tempest-VolumesSnapshotTestJSON-1023273812 None] deleted object: volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00013 in container: tempest-volumessnapshottestjson-backup-container-369271586. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:26.178026 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9fc89c92-0670-48fe-bc04-53204f346370 tempest-VolumesSnapshotTestJSON-1023273812 None] deleted object: volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00014 in container: tempest-volumessnapshottestjson-backup-container-369271586. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:26.203287 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9fc89c92-0670-48fe-bc04-53204f346370 tempest-VolumesSnapshotTestJSON-1023273812 None] deleted object: volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00015 in container: tempest-volumessnapshottestjson-backup-container-369271586. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:26.231253 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9fc89c92-0670-48fe-bc04-53204f346370 tempest-VolumesSnapshotTestJSON-1023273812 None] deleted object: volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00016 in container: tempest-volumessnapshottestjson-backup-container-369271586. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:26.259584 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9fc89c92-0670-48fe-bc04-53204f346370 tempest-VolumesSnapshotTestJSON-1023273812 None] deleted object: volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00017 in container: tempest-volumessnapshottestjson-backup-container-369271586. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:26.283904 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9fc89c92-0670-48fe-bc04-53204f346370 tempest-VolumesSnapshotTestJSON-1023273812 None] deleted object: volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00018 in container: tempest-volumessnapshottestjson-backup-container-369271586. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:26.310981 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9fc89c92-0670-48fe-bc04-53204f346370 tempest-VolumesSnapshotTestJSON-1023273812 None] deleted object: volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00019 in container: tempest-volumessnapshottestjson-backup-container-369271586. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:26.332655 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9fc89c92-0670-48fe-bc04-53204f346370 tempest-VolumesSnapshotTestJSON-1023273812 None] deleted object: volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00020 in container: tempest-volumessnapshottestjson-backup-container-369271586. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:26.362742 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9fc89c92-0670-48fe-bc04-53204f346370 tempest-VolumesSnapshotTestJSON-1023273812 None] deleted object: volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab-00021 in container: tempest-volumessnapshottestjson-backup-container-369271586. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:26.405797 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9fc89c92-0670-48fe-bc04-53204f346370 tempest-VolumesSnapshotTestJSON-1023273812 None] deleted object: volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab_metadata in container: tempest-volumessnapshottestjson-backup-container-369271586. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:26.433254 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9fc89c92-0670-48fe-bc04-53204f346370 tempest-VolumesSnapshotTestJSON-1023273812 None] deleted object: volume_5d238629-e10e-4d32-bace-5d4ba2692208/20260705033310/az_nova_backup_f7979613-42ec-4eb4-9408-15fb38fad3ab_sha256file in container: tempest-volumessnapshottestjson-backup-container-369271586. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:33:26.433428 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9fc89c92-0670-48fe-bc04-53204f346370 tempest-VolumesSnapshotTestJSON-1023273812 None] delete f7979613-42ec-4eb4-9408-15fb38fad3ab finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:33:26.469542 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-9fc89c92-0670-48fe-bc04-53204f346370 tempest-VolumesSnapshotTestJSON-1023273812 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:33:26.482781 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-9fc89c92-0670-48fe-bc04-53204f346370 tempest-VolumesSnapshotTestJSON-1023273812 None] Created reservations ['b2e8ffc1-6482-4d1b-8489-ff3dfe973abd', '149feb15-0f8a-4cf3-a338-f86fd1277a2d'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:33:26.501826 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-9fc89c92-0670-48fe-bc04-53204f346370 tempest-VolumesSnapshotTestJSON-1023273812 None] Delete backup finished, backup f7979613-42ec-4eb4-9408-15fb38fad3ab deleted. Jul 05 03:33:36.499059 np0000004562 cinder-backup[101413]: DEBUG dbcounter [-] [101413] Writing DB stats cinder:SELECT=48,cinder:UPDATE=20,cinder:INSERT=4 {{(pid=101413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:34:05.739920 np0000004562 cinder-backup[101413]: DEBUG dbcounter [-] [101413] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:34:11.749537 np0000004562 cinder-backup[101413]: DEBUG oslo_service.periodic_task [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:34:11.749965 np0000004562 cinder-backup[101413]: DEBUG cinder.manager [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Notifying Schedulers of capabilities ... {{(pid=101413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:35:11.754032 np0000004562 cinder-backup[101413]: DEBUG oslo_service.periodic_task [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:35:11.754032 np0000004562 cinder-backup[101413]: DEBUG cinder.manager [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Notifying Schedulers of capabilities ... {{(pid=101413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:36:05.740273 np0000004562 cinder-backup[101413]: DEBUG dbcounter [-] [101413] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:36:11.758367 np0000004562 cinder-backup[101413]: DEBUG oslo_service.periodic_task [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:36:11.758744 np0000004562 cinder-backup[101413]: DEBUG cinder.manager [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Notifying Schedulers of capabilities ... {{(pid=101413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:37:11.151987 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Create backup started, backup: debf834f-5e74-4f49-a226-2bd33d3f68f7 volume: c6db68c2-3cf1-46c3-b9ec-940cae35475d. Jul 05 03:37:11.160905 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T03:37:11Z,data_timestamp=2026-07-05T03:37:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-backup-164006012',encryption_key_id=None,fail_reason=None,host='np0000004562',id=debf834f-5e74-4f49-a226-2bd33d3f68f7,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='f32dcc7a997c49d486c18dd97af05b8b',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='3e0caa4aade640ee8c6307773c9bb903',volume_id=c6db68c2-3cf1-46c3-b9ec-940cae35475d) Jul 05 03:37:11.192118 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_f32dcc7a997c49d486c18dd97af05b8b {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:37:11.192501 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:37:11.192944 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:37:11.209149 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:37:11.235666 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:37:11.249553 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:37:11.249943 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:37:11.260606 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:37:11.262327 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe85:320d', 'fe80::3847:67ff:fe92:197', 'fe80::f816:3eff:fe19:b53', 'fe80::f816:3eff:fece:4a0c', 'fe80::4003:aff:fe73:5fc', 'fe80::f816:3eff:fea0:5c94', 'fe80::f816:3eff:fe9a:87e9', 'fe80::f816:3eff:fe9f:bea7', 'fe80::205d:76ff:fee7:fad5', 'fe80::f816:3eff:fef1:a5e7', 'fe80::f816:3eff:fe39:d4c', 'fe80::c02c:49ff:fe6e:7886', 'fe80::f816:3eff:fefe:bf92', 'fe80::7447:8bff:fedd:a781'] Jul 05 03:37:11.262691 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:37:11.262973 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:37:11.263409 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] <== get_connector_properties: return (70ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:37:11.761842 np0000004562 cinder-backup[101413]: DEBUG oslo_service.periodic_task [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:37:11.761977 np0000004562 cinder-backup[101413]: DEBUG cinder.manager [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Notifying Schedulers of capabilities ... {{(pid=101413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:37:11.767413 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:37:11.767776 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6db68c2-3cf1-46c3-b9ec-940cae35475d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6db68c2-3cf1-46c3-b9ec-940cae35475d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:37:11.767925 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:37:11.768369 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:37:11.768647 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6db68c2-3cf1-46c3-b9ec-940cae35475d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6db68c2-3cf1-46c3-b9ec-940cae35475d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:37:11.782423 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c6db68c2-3cf1-46c3-b9ec-940cae35475d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:37:11.783018 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c6db68c2-3cf1-46c3-b9ec-940cae35475d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:37:11.783097 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:37:11.792208 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:37:11.792208 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:37:11.803750 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c6db68c2-3cf1-46c3-b9ec-940cae35475d] added Jul 05 03:37:11.803750 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:37:11.803750 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:37:11.803750 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:37:11.803750 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:37:11.803750 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:37:11.803750 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:37:11.803965 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:37:11.804513 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0212(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:37:11.804791 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:37:12.806606 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-c6db68c2-3cf1-46c3-b9ec-940cae35475d Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:37:12.819291 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:37:12.831575 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:37:12.844950 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:37:12.844950 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:37:12.844950 np0000004562 cinder-backup[101413]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:37:12.844950 np0000004562 cinder-backup[101413]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:37:12.844950 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:37:12.845151 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:37:12.845151 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:37:12.845151 np0000004562 cinder-backup[101413]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:37:12.845151 np0000004562 cinder-backup[101413]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:37:12.845151 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:37:12.881067 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c6db68c2-3cf1-46c3-b9ec-940cae35475d, portal: 192.168.40.100,3260] Jul 05 03:37:12.881067 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c6db68c2-3cf1-46c3-b9ec-940cae35475d, portal: 192.168.40.100,3260] successful. Jul 05 03:37:12.881067 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:37:12.890933 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:37:12.902626 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:37:12.902626 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:37:12.902626 np0000004562 cinder-backup[101413]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:37:12.902626 np0000004562 cinder-backup[101413]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:37:12.902626 np0000004562 cinder-backup[101413]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6db68c2-3cf1-46c3-b9ec-940cae35475d (non-flash) Jul 05 03:37:12.902626 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:37:12.902837 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:37:12.902837 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:37:12.902837 np0000004562 cinder-backup[101413]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:37:12.902837 np0000004562 cinder-backup[101413]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:37:12.902837 np0000004562 cinder-backup[101413]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6db68c2-3cf1-46c3-b9ec-940cae35475d (non-flash) Jul 05 03:37:12.902837 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:37:12.903172 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c6db68c2-3cf1-46c3-b9ec-940cae35475d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.120s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:37:12.903323 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:37:12.904181 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] HCTL ('7', '-', '-', 0) found on session 77 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:37:12.904324 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:37:12.916060 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Searching for a device in session 77 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:37:12.916060 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6db68c2-3cf1-46c3-b9ec-940cae35475d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6db68c2-3cf1-46c3-b9ec-940cae35475d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:37:13.919933 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.151s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:37:13.920405 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] <== connect_volume: return (2152ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799066', 'path': '/dev/sdb'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:37:13.920633 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:37:13.938374 np0000004562 sudo[128450]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 05 03:37:13.939106 np0000004562 sudo[128450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:37:14.293265 np0000004562 sudo[128450]: pam_unix(sudo:session): session closed for user root Jul 05 03:37:14.295794 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.375s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:37:14.354881 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:37:14.363463 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] _create_container started, container: volumebackups,backup: debf834f-5e74-4f49-a226-2bd33d3f68f7. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:37:14.462112 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] generate_object_name_prefix: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7 {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:37:14.470377 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] starting backup of volume: c6db68c2-3cf1-46c3-b9ec-940cae35475d, volume size: 1073741824, object names prefix volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:37:14.706822 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:37:15.545728 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Compressed 52428800 bytes of data to 19825286 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:37:15.545728 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:37:15.838167 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] backup MD5 for volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00001: 82571f7121cb9475563edde615e4e4df {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:37:15.838411 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:37:16.073247 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:37:16.346898 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:37:16.347094 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:37:16.477670 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] backup MD5 for volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:37:16.478558 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:37:16.707529 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:37:16.999244 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Compressed 52428800 bytes of data to 1362154 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:37:16.999399 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:37:17.137195 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] backup MD5 for volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00003: a35891500449df17e893f84bd88472fb {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:37:17.137330 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:37:17.348115 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:37:17.590105 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:37:17.590447 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:37:17.696624 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] backup MD5 for volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:37:17.696786 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:37:17.896012 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:37:18.145348 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:37:18.145488 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:37:18.259469 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] backup MD5 for volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:37:18.259743 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:37:18.469523 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:37:18.721238 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:37:18.721636 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:37:18.834850 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] backup MD5 for volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:37:18.835006 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:37:19.055477 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:37:19.323873 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:37:19.324131 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:37:19.428663 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] backup MD5 for volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:37:19.428932 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:37:19.679067 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:37:19.954612 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:37:19.954860 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:37:20.067255 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] backup MD5 for volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:37:20.067702 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:37:20.248561 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:37:20.500363 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:37:20.500585 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:37:20.632850 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] backup MD5 for volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:37:20.632928 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:37:20.896218 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:37:21.158585 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:37:21.159518 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:37:21.290788 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] backup MD5 for volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:37:21.290909 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:37:21.495847 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:37:21.760519 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:37:21.760778 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:37:21.865633 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] backup MD5 for volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:37:21.865838 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:37:22.056682 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:37:22.324078 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:37:22.324500 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:37:22.424145 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] backup MD5 for volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:37:22.424354 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:37:22.660458 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:37:22.923628 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:37:22.923806 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:37:23.033947 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] backup MD5 for volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:37:23.034172 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:37:23.297853 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:37:23.569807 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:37:23.569807 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:37:23.689423 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] backup MD5 for volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:37:23.689605 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:37:23.923200 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:37:24.208945 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:37:24.209140 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:37:24.310385 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] backup MD5 for volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:37:24.310615 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:37:24.557354 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:37:24.835558 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:37:24.835558 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:37:24.955652 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] backup MD5 for volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:37:24.956469 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:37:25.236600 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:37:25.503542 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:37:25.503542 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:37:25.624109 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] backup MD5 for volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:37:25.624350 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:37:25.880386 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:37:26.167731 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:37:26.167945 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:37:26.274036 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] backup MD5 for volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:37:26.274203 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:37:26.483361 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:37:26.750218 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:37:26.750464 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:37:26.868962 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] backup MD5 for volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:37:26.869209 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:37:27.123251 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:37:27.378227 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:37:27.378553 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:37:27.487037 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] backup MD5 for volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:37:27.487182 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:37:27.598224 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:37:27.727030 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:37:27.727204 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:37:27.789736 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] backup MD5 for volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:37:27.790005 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:37:27.798076 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:37:27.804982 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:37:27.805133 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:37:27.809332 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:37:27.809499 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:37:27.815893 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Completed fetching metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:145}} Jul 05 03:37:27.816865 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:37:27.879014 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:37:27.879762 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] _write_metadata started, container name: volumebackups, metadata filename: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:37:27.905522 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "debf834f-5e74-4f49-a226-2bd33d3f68f7",\n "backup_name": "tempest-TestVolumeBackupRestore-backup-164006012",\n "created_at": "2026-07-05 03:37:11+00:00",\n "objects": [\n {\n "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "82571f7121cb9475563edde615e4e4df",\n "offset": 0\n }\n },\n {\n "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "a35891500449df17e893f84bd88472fb",\n "offset": 104857600\n }\n },\n {\n "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "c6db68c2-3cf1-46c3-b9ec-940cae35475d",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"c6db68c2-3cf1-46c3-b9ec-940cae35475d\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"3e0caa4aade640ee8c6307773c9bb903\\", \\"project_id\\": \\"f32dcc7a997c49d486c18dd97af05b8b\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:37:10.000000\\", \\"launched_at\\": \\"2026-07-05T03:37:10.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-TestVolumeBackupRestore-volume-1178167472\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": true, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:37:10.000000\\", \\"updated_at\\": \\"2026-07-05T03:37:11.000000\\"}, \\"volume-glance-metadata\\": {\\"hw_rng_model\\": \\"virtio\\", \\"os_glance_failed_import\\": \\"\\", \\"os_glance_importing_to_stores\\": \\"\\", \\"owner_specified.openstack.md5\\": \\"\\", \\"owner_specified.openstack.object\\": \\"images/cirros-0.6.3-x86_64-disk\\", \\"owner_specified.openstack.sha256\\": \\"\\", \\"image_id\\": \\"0c8fa207-3de5-4489-a2c5-f4cc8559edb8\\", \\"image_name\\": \\"cirros-0.6.3-x86_64-disk\\", \\"checksum\\": \\"87617e24a5e30cb3b87fda8c0764838f\\", \\"container_format\\": \\"bare\\", \\"disk_format\\": \\"qcow2\\", \\"min_disk\\": \\"0\\", \\"min_ram\\": \\"0\\", \\"size\\": \\"21692416\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:37:27.912826 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] backup debf834f-5e74-4f49-a226-2bd33d3f68f7 finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:37:28.058729 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:37:28.076698 np0000004562 sudo[129029]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 05 03:37:28.077420 np0000004562 sudo[129029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:37:28.448824 np0000004562 sudo[129029]: pam_unix(sudo:session): session closed for user root Jul 05 03:37:28.451901 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.393s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:37:28.452811 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6db68c2-3cf1-46c3-b9ec-940cae35475d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6db68c2-3cf1-46c3-b9ec-940cae35475d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799066', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:37:28.453937 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:37:28.454119 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:37:28.454612 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6db68c2-3cf1-46c3-b9ec-940cae35475d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6db68c2-3cf1-46c3-b9ec-940cae35475d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:37:28.466516 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:37:28.466516 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:37:28.466516 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:37:28.466516 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:37:28.466516 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:37:28.466516 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c Jul 05 03:37:28.466516 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:37:28.466516 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:37:28.466516 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:37:28.466516 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:37:28.466516 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-c6db68c2-3cf1-46c3-b9ec-940cae35475d Jul 05 03:37:28.466516 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:37:28.466516 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:37:28.466516 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-7d66ad98-65a6-4090-8275-5b0c7a050ae9 Jul 05 03:37:28.466516 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:37:28.466516 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:37:28.466516 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:37:28.466516 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:37:28.466516 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a Jul 05 03:37:28.466516 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:37:28.466516 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:37:28.466516 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:37:28.466516 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:37:28.466516 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:37:28.466516 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:37:28.466516 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:37:28.467483 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:37:28.467483 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:37:28.467483 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:37:28.467483 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6db68c2-3cf1-46c3-b9ec-940cae35475d', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:37:28.499547 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:37:28.499547 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:37:28.499547 np0000004562 cinder-backup[101413]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:37:28.499547 np0000004562 cinder-backup[101413]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:37:28.499547 np0000004562 cinder-backup[101413]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6db68c2-3cf1-46c3-b9ec-940cae35475d (non-flash) Jul 05 03:37:28.499547 np0000004562 cinder-backup[101413]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d66ad98-65a6-4090-8275-5b0c7a050ae9 (non-flash) Jul 05 03:37:28.499547 np0000004562 cinder-backup[101413]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d66ad98-65a6-4090-8275-5b0c7a050ae9 (non-flash) Jul 05 03:37:28.499547 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:37:28.500040 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:37:28.500040 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:37:28.500040 np0000004562 cinder-backup[101413]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:37:28.500040 np0000004562 cinder-backup[101413]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:37:28.500040 np0000004562 cinder-backup[101413]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6db68c2-3cf1-46c3-b9ec-940cae35475d (non-flash) Jul 05 03:37:28.500040 np0000004562 cinder-backup[101413]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d66ad98-65a6-4090-8275-5b0c7a050ae9 (non-flash) Jul 05 03:37:28.500040 np0000004562 cinder-backup[101413]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d66ad98-65a6-4090-8275-5b0c7a050ae9 (non-flash) Jul 05 03:37:28.500040 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:37:28.500040 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6db68c2-3cf1-46c3-b9ec-940cae35475d', '77'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d66ad98-65a6-4090-8275-5b0c7a050ae9', '80'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d66ad98-65a6-4090-8275-5b0c7a050ae9', '81')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:37:28.500381 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c6db68c2-3cf1-46c3-b9ec-940cae35475d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6db68c2-3cf1-46c3-b9ec-940cae35475d', '77')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:37:28.501113 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Resulting device map defaultdict(. at 0x72a470241d00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6db68c2-3cf1-46c3-b9ec-940cae35475d'): ({'sdb'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:37:28.501313 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Removing single pathed devices sdb {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:37:28.512917 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Flushing IO for device /dev/sdb {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:37:28.521264 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:37:28.568408 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:37:28.568627 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:37:28.570991 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:37:28.586786 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:37:28.586786 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6db68c2-3cf1-46c3-b9ec-940cae35475d')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:37:28.595438 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:37:28.635476 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 77, target: iqn.2023-03.storpool.com:os--volume-c6db68c2-3cf1-46c3-b9ec-940cae35475d, portal: 192.168.40.100,3260] Jul 05 03:37:28.635476 np0000004562 cinder-backup[101413]: Logout of [sid: 77, target: iqn.2023-03.storpool.com:os--volume-c6db68c2-3cf1-46c3-b9ec-940cae35475d, portal: 192.168.40.100,3260] successful. Jul 05 03:37:28.635476 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:37:28.652283 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:37:28.652613 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.199s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:37:28.652824 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] <== disconnect_volume: return (200ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:37:29.685096 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-4d1bdc19-5d6e-4e94-a096-e3bf56f04e9b tempest-TestVolumeBackupRestore-1760939871 None] Create backup finished. backup: debf834f-5e74-4f49-a226-2bd33d3f68f7. Jul 05 03:37:31.936427 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Restore backup started, backup: debf834f-5e74-4f49-a226-2bd33d3f68f7 volume: 48f3ec94-7b40-4e80-ba6a-556590334083. Jul 05 03:37:31.954892 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_f32dcc7a997c49d486c18dd97af05b8b {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:37:31.955083 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:37:31.955654 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:37:31.971797 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:37:31.996324 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:37:32.013592 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:37:32.014034 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:37:32.025515 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:37:32.027490 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe85:320d', 'fe80::3847:67ff:fe92:197', 'fe80::f816:3eff:fece:4a0c', 'fe80::4003:aff:fe73:5fc', 'fe80::f816:3eff:fe9f:bea7', 'fe80::205d:76ff:fee7:fad5', 'fe80::f816:3eff:fef1:a5e7', 'fe80::f816:3eff:fe39:d4c', 'fe80::c02c:49ff:fe6e:7886', 'fe80::f816:3eff:fefe:bf92', 'fe80::7447:8bff:fedd:a781'] Jul 05 03:37:32.027697 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:37:32.028275 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:37:32.028641 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] <== get_connector_properties: return (72ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:37:33.037281 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:37:33.037787 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-48f3ec94-7b40-4e80-ba6a-556590334083', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '48f3ec94-7b40-4e80-ba6a-556590334083', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:37:33.038120 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:37:33.038518 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:37:33.038784 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-48f3ec94-7b40-4e80-ba6a-556590334083', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '48f3ec94-7b40-4e80-ba6a-556590334083', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:37:33.050682 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-48f3ec94-7b40-4e80-ba6a-556590334083" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:37:33.052157 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-48f3ec94-7b40-4e80-ba6a-556590334083" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:37:33.052157 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:37:33.064030 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:37:33.064030 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:37:33.076144 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-48f3ec94-7b40-4e80-ba6a-556590334083] added Jul 05 03:37:33.076144 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:37:33.076144 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:37:33.076144 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:37:33.076144 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:37:33.076144 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:37:33.076144 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:37:33.076547 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:37:33.076883 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0253(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:37:33.076883 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:37:34.078031 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-48f3ec94-7b40-4e80-ba6a-556590334083 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:37:34.098002 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:37:34.107739 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:37:34.121046 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:37:34.121046 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:37:34.121046 np0000004562 cinder-backup[101413]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:37:34.121046 np0000004562 cinder-backup[101413]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:37:34.121046 np0000004562 cinder-backup[101413]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d66ad98-65a6-4090-8275-5b0c7a050ae9 (non-flash) Jul 05 03:37:34.121046 np0000004562 cinder-backup[101413]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d66ad98-65a6-4090-8275-5b0c7a050ae9 (non-flash) Jul 05 03:37:34.121046 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:37:34.121224 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:37:34.121224 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:37:34.121224 np0000004562 cinder-backup[101413]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:37:34.121224 np0000004562 cinder-backup[101413]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:37:34.121224 np0000004562 cinder-backup[101413]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d66ad98-65a6-4090-8275-5b0c7a050ae9 (non-flash) Jul 05 03:37:34.121224 np0000004562 cinder-backup[101413]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d66ad98-65a6-4090-8275-5b0c7a050ae9 (non-flash) Jul 05 03:37:34.121224 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:37:34.160184 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-48f3ec94-7b40-4e80-ba6a-556590334083, portal: 192.168.40.100,3260] Jul 05 03:37:34.160184 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-48f3ec94-7b40-4e80-ba6a-556590334083, portal: 192.168.40.100,3260] successful. Jul 05 03:37:34.160184 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:37:34.170995 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:37:34.185376 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:37:34.185376 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:37:34.185376 np0000004562 cinder-backup[101413]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:37:34.185376 np0000004562 cinder-backup[101413]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:37:34.185376 np0000004562 cinder-backup[101413]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d66ad98-65a6-4090-8275-5b0c7a050ae9 (non-flash) Jul 05 03:37:34.185376 np0000004562 cinder-backup[101413]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d66ad98-65a6-4090-8275-5b0c7a050ae9 (non-flash) Jul 05 03:37:34.185376 np0000004562 cinder-backup[101413]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48f3ec94-7b40-4e80-ba6a-556590334083 (non-flash) Jul 05 03:37:34.185376 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:37:34.185667 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:37:34.185667 np0000004562 cinder-backup[101413]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6fd5b51-1395-4f24-8aaa-7d0fba465c1c (non-flash) Jul 05 03:37:34.185667 np0000004562 cinder-backup[101413]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:37:34.185667 np0000004562 cinder-backup[101413]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:37:34.185667 np0000004562 cinder-backup[101413]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d66ad98-65a6-4090-8275-5b0c7a050ae9 (non-flash) Jul 05 03:37:34.185667 np0000004562 cinder-backup[101413]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d66ad98-65a6-4090-8275-5b0c7a050ae9 (non-flash) Jul 05 03:37:34.185667 np0000004562 cinder-backup[101413]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48f3ec94-7b40-4e80-ba6a-556590334083 (non-flash) Jul 05 03:37:34.185667 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:37:34.185852 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-48f3ec94-7b40-4e80-ba6a-556590334083" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.135s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:37:34.185959 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:37:34.186690 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] HCTL ('7', '-', '-', 0) found on session 82 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:37:34.186840 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:37:34.200651 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Searching for a device in session 82 and hctl ['7', '*', '*', 0] yield: None {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:37:35.202675 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Searching for a device in session 82 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:37:35.202675 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-48f3ec94-7b40-4e80-ba6a-556590334083', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '48f3ec94-7b40-4e80-ba6a-556590334083', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:37:35.202675 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.163s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:37:35.202675 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] <== connect_volume: return (2163ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799070', 'path': '/dev/sdb'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:37:35.202675 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:37:35.223011 np0000004562 sudo[129192]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 05 03:37:35.223818 np0000004562 sudo[129192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:37:35.580554 np0000004562 sudo[129192]: pam_unix(sudo:session): session closed for user root Jul 05 03:37:35.582586 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.381s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:37:35.583090 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] starting restore of backup volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7 container: volumebackups, to new volume 48f3ec94-7b40-4e80-ba6a-556590334083, backup: debf834f-5e74-4f49-a226-2bd33d3f68f7. {{(pid=101413) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jul 05 03:37:35.583456 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] _read_metadata started, container name: volumebackups, metadata filename: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7_metadata. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] _read_metadata finished. Metadata: { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "backup_description": null, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "backup_id": "debf834f-5e74-4f49-a226-2bd33d3f68f7", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "backup_name": "tempest-TestVolumeBackupRestore-backup-164006012", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "created_at": "2026-07-05 03:37:11+00:00", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "objects": [ Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00001": { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "md5": "82571f7121cb9475563edde615e4e4df", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "offset": 0 Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00002": { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "offset": 52428800 Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00003": { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "md5": "a35891500449df17e893f84bd88472fb", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "offset": 104857600 Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00004": { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "offset": 157286400 Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00005": { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "offset": 209715200 Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00006": { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "offset": 262144000 Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00007": { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "offset": 314572800 Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00008": { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "offset": 367001600 Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00009": { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "offset": 419430400 Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00010": { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "offset": 471859200 Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00011": { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "offset": 524288000 Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00012": { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "offset": 576716800 Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00013": { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "offset": 629145600 Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00014": { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "offset": 681574400 Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00015": { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "offset": 734003200 Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00016": { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "offset": 786432000 Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00017": { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "offset": 838860800 Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00018": { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "offset": 891289600 Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00019": { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "offset": 943718400 Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00020": { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "offset": 996147200 Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00021": { Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "length": 25165824, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "offset": 1048576000 Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: ], Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "parent_id": null, Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "version": "1.0.0", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "volume_id": "c6db68c2-3cf1-46c3-b9ec-940cae35475d", Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"c6db68c2-3cf1-46c3-b9ec-940cae35475d\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"3e0caa4aade640ee8c6307773c9bb903\", \"project_id\": \"f32dcc7a997c49d486c18dd97af05b8b\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004562@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T03:37:10.000000\", \"launched_at\": \"2026-07-05T03:37:10.000000\", \"terminated_at\": null, \"display_name\": \"tempest-TestVolumeBackupRestore-volume-1178167472\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": true, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"ac464b70-f08d-447b-aa26-2823b4948fc2\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T03:37:10.000000\", \"updated_at\": \"2026-07-05T03:37:11.000000\"}, \"volume-glance-metadata\": {\"hw_rng_model\": \"virtio\", \"os_glance_failed_import\": \"\", \"os_glance_importing_to_stores\": \"\", \"owner_specified.openstack.md5\": \"\", \"owner_specified.openstack.object\": \"images/cirros-0.6.3-x86_64-disk\", \"owner_specified.openstack.sha256\": \"\", \"image_id\": \"0c8fa207-3de5-4489-a2c5-f4cc8559edb8\", \"image_name\": \"cirros-0.6.3-x86_64-disk\", \"checksum\": \"87617e24a5e30cb3b87fda8c0764838f\", \"container_format\": \"bare\", \"disk_format\": \"qcow2\", \"min_disk\": \"0\", \"min_ram\": \"0\", \"size\": \"21692416\"}}" Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: }. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 03:37:35.604063 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Restoring backup version 1.0.0 {{(pid=101413) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jul 05 03:37:35.607354 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] _read_metadata started, container name: volumebackups, metadata filename: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7_metadata. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] _read_metadata finished. Metadata: { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "backup_description": null, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "backup_id": "debf834f-5e74-4f49-a226-2bd33d3f68f7", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "backup_name": "tempest-TestVolumeBackupRestore-backup-164006012", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "created_at": "2026-07-05 03:37:11+00:00", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "objects": [ Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00001": { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "md5": "82571f7121cb9475563edde615e4e4df", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "offset": 0 Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00002": { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "offset": 52428800 Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00003": { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "md5": "a35891500449df17e893f84bd88472fb", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "offset": 104857600 Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00004": { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "offset": 157286400 Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00005": { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "offset": 209715200 Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00006": { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "offset": 262144000 Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00007": { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "offset": 314572800 Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00008": { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "offset": 367001600 Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00009": { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "offset": 419430400 Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00010": { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "offset": 471859200 Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00011": { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "offset": 524288000 Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00012": { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "offset": 576716800 Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00013": { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "offset": 629145600 Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00014": { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "offset": 681574400 Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00015": { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "offset": 734003200 Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00016": { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "offset": 786432000 Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00017": { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "offset": 838860800 Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00018": { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "offset": 891289600 Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00019": { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "offset": 943718400 Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00020": { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "offset": 996147200 Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: }, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00021": { Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "length": 25165824, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "offset": 1048576000 Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: } Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: ], Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "parent_id": null, Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "version": "1.0.0", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "volume_id": "c6db68c2-3cf1-46c3-b9ec-940cae35475d", Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"c6db68c2-3cf1-46c3-b9ec-940cae35475d\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"3e0caa4aade640ee8c6307773c9bb903\", \"project_id\": \"f32dcc7a997c49d486c18dd97af05b8b\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004562@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T03:37:10.000000\", \"launched_at\": \"2026-07-05T03:37:10.000000\", \"terminated_at\": null, \"display_name\": \"tempest-TestVolumeBackupRestore-volume-1178167472\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": true, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"ac464b70-f08d-447b-aa26-2823b4948fc2\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T03:37:10.000000\", \"updated_at\": \"2026-07-05T03:37:11.000000\"}, \"volume-glance-metadata\": {\"hw_rng_model\": \"virtio\", \"os_glance_failed_import\": \"\", \"os_glance_importing_to_stores\": \"\", \"owner_specified.openstack.md5\": \"\", \"owner_specified.openstack.object\": \"images/cirros-0.6.3-x86_64-disk\", \"owner_specified.openstack.sha256\": \"\", \"image_id\": \"0c8fa207-3de5-4489-a2c5-f4cc8559edb8\", \"image_name\": \"cirros-0.6.3-x86_64-disk\", \"checksum\": \"87617e24a5e30cb3b87fda8c0764838f\", \"container_format\": \"bare\", \"disk_format\": \"qcow2\", \"min_disk\": \"0\", \"min_ram\": \"0\", \"size\": \"21692416\"}}" Jul 05 03:37:35.626425 np0000004562 cinder-backup[101413]: }. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 03:37:35.629413 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] v1 volume backup restore of debf834f-5e74-4f49-a226-2bd33d3f68f7 started. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 05 03:37:35.629413 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] metadata_object_names = ['volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00001', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00002', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00003', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00004', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00005', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00006', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00007', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00008', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00009', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00010', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00011', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00012', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00013', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00014', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00015', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00016', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00017', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00018', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00019', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00020', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00021']. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 05 03:37:35.690240 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] generated object list: ['volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00001', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00002', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00003', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00004', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00005', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00006', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00007', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00008', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00009', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00010', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00011', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00012', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00013', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00014', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00015', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00016', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00017', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00018', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00019', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00020', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00021', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7_metadata', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:37:35.736313 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:37:35.742859 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] restoring object. backup: debf834f-5e74-4f49-a226-2bd33d3f68f7, container: volumebackups, object name: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00001, volume: 48f3ec94-7b40-4e80-ba6a-556590334083. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:37:35.876143 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:37:36.625514 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] restoring object. backup: debf834f-5e74-4f49-a226-2bd33d3f68f7, container: volumebackups, object name: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00002, volume: 48f3ec94-7b40-4e80-ba6a-556590334083. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:37:36.625514 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:37:36.687966 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] restoring object. backup: debf834f-5e74-4f49-a226-2bd33d3f68f7, container: volumebackups, object name: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00003, volume: 48f3ec94-7b40-4e80-ba6a-556590334083. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:37:36.707980 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:37:37.083082 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] restoring object. backup: debf834f-5e74-4f49-a226-2bd33d3f68f7, container: volumebackups, object name: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00004, volume: 48f3ec94-7b40-4e80-ba6a-556590334083. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:37:37.100410 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:37:37.441836 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] restoring object. backup: debf834f-5e74-4f49-a226-2bd33d3f68f7, container: volumebackups, object name: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00005, volume: 48f3ec94-7b40-4e80-ba6a-556590334083. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:37:37.457240 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:37:37.801192 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] restoring object. backup: debf834f-5e74-4f49-a226-2bd33d3f68f7, container: volumebackups, object name: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00006, volume: 48f3ec94-7b40-4e80-ba6a-556590334083. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:37:37.828302 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:37:38.158411 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] restoring object. backup: debf834f-5e74-4f49-a226-2bd33d3f68f7, container: volumebackups, object name: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00007, volume: 48f3ec94-7b40-4e80-ba6a-556590334083. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:37:38.171725 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:37:38.510667 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] restoring object. backup: debf834f-5e74-4f49-a226-2bd33d3f68f7, container: volumebackups, object name: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00008, volume: 48f3ec94-7b40-4e80-ba6a-556590334083. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:37:38.534002 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:37:38.879808 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] restoring object. backup: debf834f-5e74-4f49-a226-2bd33d3f68f7, container: volumebackups, object name: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00009, volume: 48f3ec94-7b40-4e80-ba6a-556590334083. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:37:38.893649 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:37:39.248598 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] restoring object. backup: debf834f-5e74-4f49-a226-2bd33d3f68f7, container: volumebackups, object name: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00010, volume: 48f3ec94-7b40-4e80-ba6a-556590334083. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:37:39.268063 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:37:39.626329 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] restoring object. backup: debf834f-5e74-4f49-a226-2bd33d3f68f7, container: volumebackups, object name: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00011, volume: 48f3ec94-7b40-4e80-ba6a-556590334083. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:37:39.643138 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:37:40.003483 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] restoring object. backup: debf834f-5e74-4f49-a226-2bd33d3f68f7, container: volumebackups, object name: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00012, volume: 48f3ec94-7b40-4e80-ba6a-556590334083. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:37:40.019704 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:37:40.387206 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] restoring object. backup: debf834f-5e74-4f49-a226-2bd33d3f68f7, container: volumebackups, object name: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00013, volume: 48f3ec94-7b40-4e80-ba6a-556590334083. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:37:40.407735 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:37:40.770036 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] restoring object. backup: debf834f-5e74-4f49-a226-2bd33d3f68f7, container: volumebackups, object name: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00014, volume: 48f3ec94-7b40-4e80-ba6a-556590334083. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:37:40.793608 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:37:41.184009 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] restoring object. backup: debf834f-5e74-4f49-a226-2bd33d3f68f7, container: volumebackups, object name: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00015, volume: 48f3ec94-7b40-4e80-ba6a-556590334083. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:37:41.203161 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:37:41.576302 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] restoring object. backup: debf834f-5e74-4f49-a226-2bd33d3f68f7, container: volumebackups, object name: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00016, volume: 48f3ec94-7b40-4e80-ba6a-556590334083. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:37:41.593247 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:37:41.966308 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] restoring object. backup: debf834f-5e74-4f49-a226-2bd33d3f68f7, container: volumebackups, object name: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00017, volume: 48f3ec94-7b40-4e80-ba6a-556590334083. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:37:41.982547 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:37:42.341153 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] restoring object. backup: debf834f-5e74-4f49-a226-2bd33d3f68f7, container: volumebackups, object name: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00018, volume: 48f3ec94-7b40-4e80-ba6a-556590334083. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:37:42.366227 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:37:42.730912 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] restoring object. backup: debf834f-5e74-4f49-a226-2bd33d3f68f7, container: volumebackups, object name: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00019, volume: 48f3ec94-7b40-4e80-ba6a-556590334083. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:37:42.753623 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:37:43.109655 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] restoring object. backup: debf834f-5e74-4f49-a226-2bd33d3f68f7, container: volumebackups, object name: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00020, volume: 48f3ec94-7b40-4e80-ba6a-556590334083. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:37:43.128667 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:37:43.477308 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] restoring object. backup: debf834f-5e74-4f49-a226-2bd33d3f68f7, container: volumebackups, object name: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00021, volume: 48f3ec94-7b40-4e80-ba6a-556590334083. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:37:43.501260 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:37:43.683601 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] v1 volume backup restore of debf834f-5e74-4f49-a226-2bd33d3f68f7 finished. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 05 03:37:43.683601 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Restoring volume base metadata {{(pid=101413) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 05 03:37:43.696593 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] No metadata of type 'volume-metadata' to restore {{(pid=101413) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 05 03:37:43.697125 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Restoring volume glance metadata {{(pid=101413) _restore_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:258}} Jul 05 03:37:43.820415 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] restore debf834f-5e74-4f49-a226-2bd33d3f68f7 to 48f3ec94-7b40-4e80-ba6a-556590334083 finished. {{(pid=101413) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jul 05 03:37:43.828734 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:37:43.849371 np0000004562 sudo[129555]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 05 03:37:43.850255 np0000004562 sudo[129555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:37:44.211881 np0000004562 sudo[129555]: pam_unix(sudo:session): session closed for user root Jul 05 03:37:44.214127 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.385s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:37:44.214857 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-48f3ec94-7b40-4e80-ba6a-556590334083', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '48f3ec94-7b40-4e80-ba6a-556590334083', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799070', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:37:44.215061 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:37:46.476484 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.260s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:37:46.476484 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-48f3ec94-7b40-4e80-ba6a-556590334083', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '48f3ec94-7b40-4e80-ba6a-556590334083', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:37:46.489295 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:37:46.489295 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:37:46.489295 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:37:46.489295 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:37:46.489295 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:37:46.489295 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-0d180e3e-190d-42b2-b8dc-3480c3b381f7 Jul 05 03:37:46.489295 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:37:46.489295 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:37:46.489295 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:37:46.489295 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:37:46.489295 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-7d66ad98-65a6-4090-8275-5b0c7a050ae9 Jul 05 03:37:46.489295 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:37:46.489295 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:37:46.489295 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:37:46.489295 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:37:46.489295 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-48f3ec94-7b40-4e80-ba6a-556590334083 Jul 05 03:37:46.489295 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:37:46.489295 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:37:46.489295 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-343c23b9-d610-4d44-819e-8c210b3ec2db Jul 05 03:37:46.489295 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:37:46.489295 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:37:46.489295 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:37:46.489295 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:37:46.489295 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a Jul 05 03:37:46.489295 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:37:46.489295 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:37:46.489295 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:37:46.489295 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:37:46.489295 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:37:46.489295 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:37:46.489295 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:37:46.491303 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:37:46.491303 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:37:46.491303 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:37:46.491303 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48f3ec94-7b40-4e80-ba6a-556590334083', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:37:46.526817 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:37:46.526817 np0000004562 cinder-backup[101413]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:37:46.526817 np0000004562 cinder-backup[101413]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d66ad98-65a6-4090-8275-5b0c7a050ae9 (non-flash) Jul 05 03:37:46.526817 np0000004562 cinder-backup[101413]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d66ad98-65a6-4090-8275-5b0c7a050ae9 (non-flash) Jul 05 03:37:46.526817 np0000004562 cinder-backup[101413]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48f3ec94-7b40-4e80-ba6a-556590334083 (non-flash) Jul 05 03:37:46.526817 np0000004562 cinder-backup[101413]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d180e3e-190d-42b2-b8dc-3480c3b381f7 (non-flash) Jul 05 03:37:46.526817 np0000004562 cinder-backup[101413]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d180e3e-190d-42b2-b8dc-3480c3b381f7 (non-flash) Jul 05 03:37:46.526817 np0000004562 cinder-backup[101413]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-343c23b9-d610-4d44-819e-8c210b3ec2db (non-flash) Jul 05 03:37:46.526817 np0000004562 cinder-backup[101413]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-343c23b9-d610-4d44-819e-8c210b3ec2db (non-flash) Jul 05 03:37:46.526817 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:37:46.526817 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:37:46.526817 np0000004562 cinder-backup[101413]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:37:46.526817 np0000004562 cinder-backup[101413]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d66ad98-65a6-4090-8275-5b0c7a050ae9 (non-flash) Jul 05 03:37:46.526817 np0000004562 cinder-backup[101413]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d66ad98-65a6-4090-8275-5b0c7a050ae9 (non-flash) Jul 05 03:37:46.526817 np0000004562 cinder-backup[101413]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48f3ec94-7b40-4e80-ba6a-556590334083 (non-flash) Jul 05 03:37:46.526817 np0000004562 cinder-backup[101413]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d180e3e-190d-42b2-b8dc-3480c3b381f7 (non-flash) Jul 05 03:37:46.526817 np0000004562 cinder-backup[101413]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d180e3e-190d-42b2-b8dc-3480c3b381f7 (non-flash) Jul 05 03:37:46.526817 np0000004562 cinder-backup[101413]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-343c23b9-d610-4d44-819e-8c210b3ec2db (non-flash) Jul 05 03:37:46.526817 np0000004562 cinder-backup[101413]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-343c23b9-d610-4d44-819e-8c210b3ec2db (non-flash) Jul 05 03:37:46.526817 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:37:46.526817 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a', '70'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d66ad98-65a6-4090-8275-5b0c7a050ae9', '80'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d66ad98-65a6-4090-8275-5b0c7a050ae9', '81'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48f3ec94-7b40-4e80-ba6a-556590334083', '82'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d180e3e-190d-42b2-b8dc-3480c3b381f7', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d180e3e-190d-42b2-b8dc-3480c3b381f7', '84'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-343c23b9-d610-4d44-819e-8c210b3ec2db', '85'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-343c23b9-d610-4d44-819e-8c210b3ec2db', '86')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:37:46.526817 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-48f3ec94-7b40-4e80-ba6a-556590334083, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48f3ec94-7b40-4e80-ba6a-556590334083', '82')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:37:46.526817 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Resulting device map defaultdict(. at 0x72a47001fec0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48f3ec94-7b40-4e80-ba6a-556590334083'): ({'sdb'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:37:46.526817 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Removing single pathed devices sdb {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:37:46.544634 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Flushing IO for device /dev/sdb {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:37:46.557496 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:37:46.613802 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:37:46.614115 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:37:46.615649 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:37:46.627203 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:37:46.627203 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48f3ec94-7b40-4e80-ba6a-556590334083')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:37:46.639817 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:37:46.680418 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 82, target: iqn.2023-03.storpool.com:os--volume-48f3ec94-7b40-4e80-ba6a-556590334083, portal: 192.168.40.100,3260] Jul 05 03:37:46.680418 np0000004562 cinder-backup[101413]: Logout of [sid: 82, target: iqn.2023-03.storpool.com:os--volume-48f3ec94-7b40-4e80-ba6a-556590334083, portal: 192.168.40.100,3260] successful. Jul 05 03:37:46.680418 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:37:46.701455 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:37:46.701455 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.225s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:37:46.701455 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] <== disconnect_volume: return (2485ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:37:47.727327 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.manager [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Encryption key ID for volume 48f3ec94-7b40-4e80-ba6a-556590334083 already matches encryption key ID in backup debf834f-5e74-4f49-a226-2bd33d3f68f7. {{(pid=101413) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jul 05 03:37:47.803652 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-8ed50d56-eeea-46e4-bacc-1fb4db344193 tempest-TestVolumeBackupRestore-1760939871 None] Finished restoring backup debf834f-5e74-4f49-a226-2bd33d3f68f7 to volume 48f3ec94-7b40-4e80-ba6a-556590334083. Jul 05 03:38:05.743132 np0000004562 cinder-backup[101413]: DEBUG dbcounter [-] [101413] Writing DB stats cinder:SELECT=88,cinder:UPDATE=12,cinder:INSERT=15 {{(pid=101413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:38:11.765538 np0000004562 cinder-backup[101413]: DEBUG oslo_service.periodic_task [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:38:11.766126 np0000004562 cinder-backup[101413]: DEBUG cinder.manager [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Notifying Schedulers of capabilities ... {{(pid=101413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:38:49.371427 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-e8b93b50-2b60-454f-b479-fbacfb0a158b tempest-TestVolumeBackupRestore-1760939871 None] Delete backup started, backup: debf834f-5e74-4f49-a226-2bd33d3f68f7. Jul 05 03:38:49.376366 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-e8b93b50-2b60-454f-b479-fbacfb0a158b tempest-TestVolumeBackupRestore-1760939871 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_f32dcc7a997c49d486c18dd97af05b8b {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:38:49.376738 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-e8b93b50-2b60-454f-b479-fbacfb0a158b tempest-TestVolumeBackupRestore-1760939871 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:38:49.377036 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8b93b50-2b60-454f-b479-fbacfb0a158b tempest-TestVolumeBackupRestore-1760939871 None] delete started, backup: debf834f-5e74-4f49-a226-2bd33d3f68f7, container: volumebackups, prefix: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:38:49.459240 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8b93b50-2b60-454f-b479-fbacfb0a158b tempest-TestVolumeBackupRestore-1760939871 None] generated object list: ['volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00001', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00002', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00003', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00004', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00005', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00006', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00007', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00008', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00009', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00010', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00011', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00012', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00013', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00014', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00015', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00016', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00017', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00018', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00019', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00020', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00021', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7_metadata', 'volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:38:49.487938 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8b93b50-2b60-454f-b479-fbacfb0a158b tempest-TestVolumeBackupRestore-1760939871 None] deleted object: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00001 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:38:49.510741 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8b93b50-2b60-454f-b479-fbacfb0a158b tempest-TestVolumeBackupRestore-1760939871 None] deleted object: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00002 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:38:49.533726 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8b93b50-2b60-454f-b479-fbacfb0a158b tempest-TestVolumeBackupRestore-1760939871 None] deleted object: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00003 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:38:49.552436 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8b93b50-2b60-454f-b479-fbacfb0a158b tempest-TestVolumeBackupRestore-1760939871 None] deleted object: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00004 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:38:49.572737 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8b93b50-2b60-454f-b479-fbacfb0a158b tempest-TestVolumeBackupRestore-1760939871 None] deleted object: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00005 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:38:49.593622 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8b93b50-2b60-454f-b479-fbacfb0a158b tempest-TestVolumeBackupRestore-1760939871 None] deleted object: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00006 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:38:49.613512 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8b93b50-2b60-454f-b479-fbacfb0a158b tempest-TestVolumeBackupRestore-1760939871 None] deleted object: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00007 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:38:49.631947 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8b93b50-2b60-454f-b479-fbacfb0a158b tempest-TestVolumeBackupRestore-1760939871 None] deleted object: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00008 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:38:49.650733 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8b93b50-2b60-454f-b479-fbacfb0a158b tempest-TestVolumeBackupRestore-1760939871 None] deleted object: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00009 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:38:49.671776 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8b93b50-2b60-454f-b479-fbacfb0a158b tempest-TestVolumeBackupRestore-1760939871 None] deleted object: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00010 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:38:49.692464 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8b93b50-2b60-454f-b479-fbacfb0a158b tempest-TestVolumeBackupRestore-1760939871 None] deleted object: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00011 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:38:49.711738 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8b93b50-2b60-454f-b479-fbacfb0a158b tempest-TestVolumeBackupRestore-1760939871 None] deleted object: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00012 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:38:49.730737 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8b93b50-2b60-454f-b479-fbacfb0a158b tempest-TestVolumeBackupRestore-1760939871 None] deleted object: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00013 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:38:49.753656 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8b93b50-2b60-454f-b479-fbacfb0a158b tempest-TestVolumeBackupRestore-1760939871 None] deleted object: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00014 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:38:49.776141 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8b93b50-2b60-454f-b479-fbacfb0a158b tempest-TestVolumeBackupRestore-1760939871 None] deleted object: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00015 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:38:49.811734 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8b93b50-2b60-454f-b479-fbacfb0a158b tempest-TestVolumeBackupRestore-1760939871 None] deleted object: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00016 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:38:49.853310 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8b93b50-2b60-454f-b479-fbacfb0a158b tempest-TestVolumeBackupRestore-1760939871 None] deleted object: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00017 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:38:49.887753 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8b93b50-2b60-454f-b479-fbacfb0a158b tempest-TestVolumeBackupRestore-1760939871 None] deleted object: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00018 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:38:49.917921 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8b93b50-2b60-454f-b479-fbacfb0a158b tempest-TestVolumeBackupRestore-1760939871 None] deleted object: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00019 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:38:49.952077 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8b93b50-2b60-454f-b479-fbacfb0a158b tempest-TestVolumeBackupRestore-1760939871 None] deleted object: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00020 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:38:49.982828 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8b93b50-2b60-454f-b479-fbacfb0a158b tempest-TestVolumeBackupRestore-1760939871 None] deleted object: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7-00021 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:38:50.015008 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8b93b50-2b60-454f-b479-fbacfb0a158b tempest-TestVolumeBackupRestore-1760939871 None] deleted object: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7_metadata in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:38:50.053593 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8b93b50-2b60-454f-b479-fbacfb0a158b tempest-TestVolumeBackupRestore-1760939871 None] deleted object: volume_c6db68c2-3cf1-46c3-b9ec-940cae35475d/20260705033714/az_nova_backup_debf834f-5e74-4f49-a226-2bd33d3f68f7_sha256file in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:38:50.053865 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e8b93b50-2b60-454f-b479-fbacfb0a158b tempest-TestVolumeBackupRestore-1760939871 None] delete debf834f-5e74-4f49-a226-2bd33d3f68f7 finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:38:50.103880 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-e8b93b50-2b60-454f-b479-fbacfb0a158b tempest-TestVolumeBackupRestore-1760939871 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:38:50.121545 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-e8b93b50-2b60-454f-b479-fbacfb0a158b tempest-TestVolumeBackupRestore-1760939871 None] Created reservations ['114bee01-1d67-422b-a04a-4429fca8fdfa', '05e90cd7-6eb2-4aac-832a-d6fbe61a2a52'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:38:50.147968 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-e8b93b50-2b60-454f-b479-fbacfb0a158b tempest-TestVolumeBackupRestore-1760939871 None] Delete backup finished, backup debf834f-5e74-4f49-a226-2bd33d3f68f7 deleted. Jul 05 03:39:00.141797 np0000004562 cinder-backup[101413]: DEBUG dbcounter [-] [101413] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=6 {{(pid=101413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:39:09.398990 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Create backup started, backup: abd27258-b7aa-4d90-931f-2e1f16345e68 volume: 437af98e-5b46-467f-8ffb-31218d021c7e. Jul 05 03:39:09.405674 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupsv39test-backup-container-1880347674',created_at=2026-07-05T03:39:09Z,data_timestamp=2026-07-05T03:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Backup-954598185',encryption_key_id=None,fail_reason=None,host='np0000004562',id=abd27258-b7aa-4d90-931f-2e1f16345e68,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='d6057b8db26f45aeaae2a701b9396ba5',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='81070477b42d44078d866291363a84e1',volume_id=437af98e-5b46-467f-8ffb-31218d021c7e) Jul 05 03:39:09.432109 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_d6057b8db26f45aeaae2a701b9396ba5 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:39:09.432289 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:39:09.432698 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:39:09.444908 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:39:09.468409 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:39:09.484095 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:39:09.484462 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:39:09.493868 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:39:09.496374 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fece:4a0c', 'fe80::4003:aff:fe73:5fc', 'fe80::f816:3eff:fef1:a5e7', 'fe80::f816:3eff:fe25:67db', 'fe80::4871:a0ff:feb5:e1d', 'fe80::f816:3eff:fe7d:7daa', 'fe80::c813:fdff:fe18:febe', 'fe80::f816:3eff:fede:6337', 'fe80::287f:a7ff:fe85:1a18', 'fe80::7447:8bff:fedd:a781'] Jul 05 03:39:09.496732 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:39:09.496910 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:39:09.497247 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] <== get_connector_properties: return (64ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:39:10.002737 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:39:10.003579 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-437af98e-5b46-467f-8ffb-31218d021c7e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '437af98e-5b46-467f-8ffb-31218d021c7e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:39:10.003858 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:39:10.004367 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:39:10.004648 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-437af98e-5b46-467f-8ffb-31218d021c7e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '437af98e-5b46-467f-8ffb-31218d021c7e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:39:10.018005 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-437af98e-5b46-467f-8ffb-31218d021c7e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:39:10.018585 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-437af98e-5b46-467f-8ffb-31218d021c7e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:39:10.018951 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:39:10.030877 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:39:10.030877 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:39:10.042366 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-437af98e-5b46-467f-8ffb-31218d021c7e] added Jul 05 03:39:10.042366 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:39:10.042366 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:39:10.042366 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:39:10.042366 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:39:10.042366 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:39:10.042366 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:39:10.042684 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:39:10.043182 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0242(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:39:10.043704 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:39:11.045003 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-437af98e-5b46-467f-8ffb-31218d021c7e Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:39:11.056408 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:39:11.066134 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:39:11.080983 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:39:11.080983 np0000004562 cinder-backup[101413]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:39:11.080983 np0000004562 cinder-backup[101413]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-343c23b9-d610-4d44-819e-8c210b3ec2db (non-flash) Jul 05 03:39:11.080983 np0000004562 cinder-backup[101413]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-343c23b9-d610-4d44-819e-8c210b3ec2db (non-flash) Jul 05 03:39:11.080983 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:39:11.081332 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:39:11.081332 np0000004562 cinder-backup[101413]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:39:11.081332 np0000004562 cinder-backup[101413]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-343c23b9-d610-4d44-819e-8c210b3ec2db (non-flash) Jul 05 03:39:11.081332 np0000004562 cinder-backup[101413]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-343c23b9-d610-4d44-819e-8c210b3ec2db (non-flash) Jul 05 03:39:11.081332 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:39:11.118466 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-437af98e-5b46-467f-8ffb-31218d021c7e, portal: 192.168.40.100,3260] Jul 05 03:39:11.118466 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-437af98e-5b46-467f-8ffb-31218d021c7e, portal: 192.168.40.100,3260] successful. Jul 05 03:39:11.118466 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:39:11.130167 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:39:11.155408 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:39:11.155408 np0000004562 cinder-backup[101413]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:39:11.155408 np0000004562 cinder-backup[101413]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-343c23b9-d610-4d44-819e-8c210b3ec2db (non-flash) Jul 05 03:39:11.155408 np0000004562 cinder-backup[101413]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-343c23b9-d610-4d44-819e-8c210b3ec2db (non-flash) Jul 05 03:39:11.155408 np0000004562 cinder-backup[101413]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437af98e-5b46-467f-8ffb-31218d021c7e (non-flash) Jul 05 03:39:11.155408 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:39:11.155408 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:39:11.155408 np0000004562 cinder-backup[101413]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:39:11.155408 np0000004562 cinder-backup[101413]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-343c23b9-d610-4d44-819e-8c210b3ec2db (non-flash) Jul 05 03:39:11.155408 np0000004562 cinder-backup[101413]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-343c23b9-d610-4d44-819e-8c210b3ec2db (non-flash) Jul 05 03:39:11.155408 np0000004562 cinder-backup[101413]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437af98e-5b46-467f-8ffb-31218d021c7e (non-flash) Jul 05 03:39:11.155408 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:39:11.155408 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-437af98e-5b46-467f-8ffb-31218d021c7e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:39:11.156015 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:39:11.158594 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] HCTL ('9', '-', '-', 0) found on session 97 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:39:11.158594 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Scanning host 9 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:39:11.179147 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Searching for a device in session 97 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:39:11.180999 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-437af98e-5b46-467f-8ffb-31218d021c7e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '437af98e-5b46-467f-8ffb-31218d021c7e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:39:11.768535 np0000004562 cinder-backup[101413]: DEBUG oslo_service.periodic_task [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:39:11.768828 np0000004562 cinder-backup[101413]: DEBUG cinder.manager [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Notifying Schedulers of capabilities ... {{(pid=101413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:39:12.188494 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.184s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:39:12.189272 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] <== connect_volume: return (2184ms) {'type': 'block', 'scsi_wwn': '330000000862cea72', 'path': '/dev/sdd'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:39:12.190049 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:39:12.208665 np0000004562 sudo[132427]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd Jul 05 03:39:12.209547 np0000004562 sudo[132427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:39:12.635869 np0000004562 sudo[132427]: pam_unix(sudo:session): session closed for user root Jul 05 03:39:12.638543 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd" returned: 0 in 0.448s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:39:12.699588 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:39:12.706847 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] _create_container started, container: tempest-volumesbackupsv39test-backup-container-1880347674,backup: abd27258-b7aa-4d90-931f-2e1f16345e68. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:39:12.876347 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] generate_object_name_prefix: volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68 {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:39:12.881912 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] starting backup of volume: 437af98e-5b46-467f-8ffb-31218d021c7e, volume size: 1073741824, object names prefix volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:39:13.104585 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:39:13.356700 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:39:13.357263 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:39:13.491315 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] backup MD5 for volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:39:13.491433 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:39:13.731494 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:39:13.985080 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:39:13.985232 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:39:14.101048 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] backup MD5 for volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:39:14.101048 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:39:14.322730 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:39:14.604154 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:39:14.604154 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:39:14.724398 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] backup MD5 for volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:39:14.724606 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:39:14.957029 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:39:15.223343 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:39:15.223527 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:39:15.329092 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] backup MD5 for volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:39:15.329370 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:39:15.563231 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:39:15.851202 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:39:15.851505 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:39:15.962939 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] backup MD5 for volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:39:15.963071 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:39:16.184587 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:39:16.431115 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:39:16.431290 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:39:16.529931 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] backup MD5 for volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:39:16.530158 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:39:16.730350 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:39:16.978229 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:39:16.978587 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:39:17.090779 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] backup MD5 for volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:39:17.090779 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:39:17.310975 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:39:17.575680 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:39:17.575868 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:39:17.698295 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] backup MD5 for volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:39:17.698498 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:39:17.897696 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:39:18.142203 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:39:18.142634 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:39:18.239056 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] backup MD5 for volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:39:18.239219 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:39:18.460928 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:39:18.706870 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:39:18.707036 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:39:18.807934 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] backup MD5 for volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:39:18.808109 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:39:19.061075 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:39:19.319428 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:39:19.319894 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:39:19.436476 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] backup MD5 for volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:39:19.436707 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:39:19.629397 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:39:19.875777 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:39:19.875777 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:39:19.982517 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] backup MD5 for volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:39:19.982759 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:39:20.186966 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:39:20.429314 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:39:20.429782 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:39:20.529056 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] backup MD5 for volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:39:20.529336 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:39:20.756960 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:39:21.037843 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:39:21.037976 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:39:21.138375 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] backup MD5 for volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:39:21.138509 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:39:21.333987 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:39:21.608486 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:39:21.609055 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:39:21.705958 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] backup MD5 for volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:39:21.706103 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:39:21.958526 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:39:22.250849 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:39:22.250999 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:39:22.356709 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] backup MD5 for volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:39:22.356882 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:39:22.573848 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:39:22.830623 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:39:22.831037 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:39:22.926206 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] backup MD5 for volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:39:22.926402 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:39:23.101554 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:39:23.344256 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:39:23.344396 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:39:23.439428 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] backup MD5 for volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:39:23.439674 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:39:23.663100 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:39:23.934964 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:39:23.935370 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:39:24.043450 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] backup MD5 for volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:39:24.043643 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:39:24.253537 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:39:24.603737 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:39:24.603737 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:39:24.702158 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] backup MD5 for volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:39:24.702331 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:39:24.808320 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:39:24.942464 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:39:24.942827 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:39:25.030025 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] backup MD5 for volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:39:25.030189 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:39:25.037943 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:39:25.043647 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:39:25.043806 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:39:25.047091 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:39:25.047218 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:39:25.050461 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:39:25.050780 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] _write_sha256file started, container name: tempest-volumesbackupsv39test-backup-container-1880347674, sha256file filename: volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:39:25.120918 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:39:25.121731 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] _write_metadata started, container name: tempest-volumesbackupsv39test-backup-container-1880347674, metadata filename: volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:39:25.157933 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "abd27258-b7aa-4d90-931f-2e1f16345e68",\n "backup_name": "tempest-VolumesBackupsV39Test-Backup-954598185",\n "created_at": "2026-07-05 03:39:09+00:00",\n "objects": [\n {\n "volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "437af98e-5b46-467f-8ffb-31218d021c7e",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"437af98e-5b46-467f-8ffb-31218d021c7e\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"81070477b42d44078d866291363a84e1\\", \\"project_id\\": \\"d6057b8db26f45aeaae2a701b9396ba5\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:39:08.000000\\", \\"launched_at\\": \\"2026-07-05T03:39:08.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsV39Test-Volume-2115957563\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:39:08.000000\\", \\"updated_at\\": \\"2026-07-05T03:39:09.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:39:25.166461 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] backup abd27258-b7aa-4d90-931f-2e1f16345e68 finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:39:25.288486 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:39:25.308227 np0000004562 sudo[133134]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd Jul 05 03:39:25.309030 np0000004562 sudo[133134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:39:25.644969 np0000004562 sudo[133134]: pam_unix(sudo:session): session closed for user root Jul 05 03:39:25.647139 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd" returned: 0 in 0.358s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:39:25.647802 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-437af98e-5b46-467f-8ffb-31218d021c7e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '437af98e-5b46-467f-8ffb-31218d021c7e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000862cea72', 'path': '/dev/sdd'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:39:25.648007 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:39:26.805232 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.157s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:39:26.805810 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-437af98e-5b46-467f-8ffb-31218d021c7e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '437af98e-5b46-467f-8ffb-31218d021c7e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-343c23b9-d610-4d44-819e-8c210b3ec2db Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-7aa9d7fd-1ddd-4bc9-8dd7-61ed704a19dc Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-9b14a886-f38f-46f0-94fb-0dd3199ed207 Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-437af98e-5b46-467f-8ffb-31218d021c7e Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:39:26.821032 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:39:26.821874 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:39:26.821874 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:39:26.821874 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:39:26.821874 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-437af98e-5b46-467f-8ffb-31218d021c7e', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:39:26.853969 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7aa9d7fd-1ddd-4bc9-8dd7-61ed704a19dc (non-flash) Jul 05 03:39:26.853969 np0000004562 cinder-backup[101413]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7aa9d7fd-1ddd-4bc9-8dd7-61ed704a19dc (non-flash) Jul 05 03:39:26.853969 np0000004562 cinder-backup[101413]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b14a886-f38f-46f0-94fb-0dd3199ed207 (non-flash) Jul 05 03:39:26.853969 np0000004562 cinder-backup[101413]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b14a886-f38f-46f0-94fb-0dd3199ed207 (non-flash) Jul 05 03:39:26.853969 np0000004562 cinder-backup[101413]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:39:26.853969 np0000004562 cinder-backup[101413]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:39:26.853969 np0000004562 cinder-backup[101413]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-343c23b9-d610-4d44-819e-8c210b3ec2db (non-flash) Jul 05 03:39:26.853969 np0000004562 cinder-backup[101413]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-343c23b9-d610-4d44-819e-8c210b3ec2db (non-flash) Jul 05 03:39:26.853969 np0000004562 cinder-backup[101413]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437af98e-5b46-467f-8ffb-31218d021c7e (non-flash) Jul 05 03:39:26.853969 np0000004562 cinder-backup[101413]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:39:26.853969 np0000004562 cinder-backup[101413]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:39:26.853969 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:39:26.854372 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7aa9d7fd-1ddd-4bc9-8dd7-61ed704a19dc (non-flash) Jul 05 03:39:26.854372 np0000004562 cinder-backup[101413]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7aa9d7fd-1ddd-4bc9-8dd7-61ed704a19dc (non-flash) Jul 05 03:39:26.854372 np0000004562 cinder-backup[101413]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b14a886-f38f-46f0-94fb-0dd3199ed207 (non-flash) Jul 05 03:39:26.854372 np0000004562 cinder-backup[101413]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b14a886-f38f-46f0-94fb-0dd3199ed207 (non-flash) Jul 05 03:39:26.854372 np0000004562 cinder-backup[101413]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:39:26.854372 np0000004562 cinder-backup[101413]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:39:26.854372 np0000004562 cinder-backup[101413]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-343c23b9-d610-4d44-819e-8c210b3ec2db (non-flash) Jul 05 03:39:26.854372 np0000004562 cinder-backup[101413]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-343c23b9-d610-4d44-819e-8c210b3ec2db (non-flash) Jul 05 03:39:26.854372 np0000004562 cinder-backup[101413]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-437af98e-5b46-467f-8ffb-31218d021c7e (non-flash) Jul 05 03:39:26.854372 np0000004562 cinder-backup[101413]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:39:26.854372 np0000004562 cinder-backup[101413]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:39:26.854372 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:39:26.854372 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7aa9d7fd-1ddd-4bc9-8dd7-61ed704a19dc', '100'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7aa9d7fd-1ddd-4bc9-8dd7-61ed704a19dc', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b14a886-f38f-46f0-94fb-0dd3199ed207', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b14a886-f38f-46f0-94fb-0dd3199ed207', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-343c23b9-d610-4d44-819e-8c210b3ec2db', '95'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-343c23b9-d610-4d44-819e-8c210b3ec2db', '96'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-437af98e-5b46-467f-8ffb-31218d021c7e', '97'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce', '98'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce', '99')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:39:26.854684 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-437af98e-5b46-467f-8ffb-31218d021c7e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-437af98e-5b46-467f-8ffb-31218d021c7e', '97')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:39:26.856080 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Resulting device map defaultdict(. at 0x72a4705445e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-437af98e-5b46-467f-8ffb-31218d021c7e'): ({'sdd'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:39:26.856344 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Removing single pathed devices sdd {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:39:26.867304 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Flushing IO for device /dev/sdd {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:39:26.878813 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:39:26.926072 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Checking to see if SCSI volumes sdd have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:39:26.926230 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] SCSI volumes sdd have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:39:26.928120 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Checking to see if device paths {'sdd'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:39:26.944551 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Device paths {'sdd'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:39:26.944551 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-437af98e-5b46-467f-8ffb-31218d021c7e')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:39:26.954758 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:39:26.994771 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 97, target: iqn.2023-03.storpool.com:os--volume-437af98e-5b46-467f-8ffb-31218d021c7e, portal: 192.168.40.100,3260] Jul 05 03:39:26.994771 np0000004562 cinder-backup[101413]: Logout of [sid: 97, target: iqn.2023-03.storpool.com:os--volume-437af98e-5b46-467f-8ffb-31218d021c7e, portal: 192.168.40.100,3260] successful. Jul 05 03:39:26.994771 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:39:27.011873 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:39:27.012145 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.207s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:39:27.012319 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] <== disconnect_volume: return (1364ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:39:28.031476 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-6f952db6-a1da-40be-8ee4-d2ebd1ef2134 tempest-VolumesBackupsV39Test-263818218 None] Create backup finished. backup: abd27258-b7aa-4d90-931f-2e1f16345e68. Jul 05 03:39:29.006847 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-16c08104-43ea-4cdf-ae37-a0d328f53cc0 tempest-VolumesBackupsV39Test-263818218 None] Delete backup started, backup: abd27258-b7aa-4d90-931f-2e1f16345e68. Jul 05 03:39:29.011233 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-16c08104-43ea-4cdf-ae37-a0d328f53cc0 tempest-VolumesBackupsV39Test-263818218 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_d6057b8db26f45aeaae2a701b9396ba5 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:39:29.012502 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-16c08104-43ea-4cdf-ae37-a0d328f53cc0 tempest-VolumesBackupsV39Test-263818218 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:39:29.012795 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-16c08104-43ea-4cdf-ae37-a0d328f53cc0 tempest-VolumesBackupsV39Test-263818218 None] delete started, backup: abd27258-b7aa-4d90-931f-2e1f16345e68, container: tempest-volumesbackupsv39test-backup-container-1880347674, prefix: volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:39:29.055740 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-16c08104-43ea-4cdf-ae37-a0d328f53cc0 tempest-VolumesBackupsV39Test-263818218 None] generated object list: ['volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00001', 'volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00002', 'volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00003', 'volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00004', 'volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00005', 'volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00006', 'volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00007', 'volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00008', 'volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00009', 'volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00010', 'volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00011', 'volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00012', 'volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00013', 'volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00014', 'volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00015', 'volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00016', 'volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00017', 'volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00018', 'volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00019', 'volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00020', 'volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00021', 'volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68_metadata', 'volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:39:29.084556 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-16c08104-43ea-4cdf-ae37-a0d328f53cc0 tempest-VolumesBackupsV39Test-263818218 None] deleted object: volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00001 in container: tempest-volumesbackupsv39test-backup-container-1880347674. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:39:29.113429 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-16c08104-43ea-4cdf-ae37-a0d328f53cc0 tempest-VolumesBackupsV39Test-263818218 None] deleted object: volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00002 in container: tempest-volumesbackupsv39test-backup-container-1880347674. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:39:29.144996 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-16c08104-43ea-4cdf-ae37-a0d328f53cc0 tempest-VolumesBackupsV39Test-263818218 None] deleted object: volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00003 in container: tempest-volumesbackupsv39test-backup-container-1880347674. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:39:29.180882 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-16c08104-43ea-4cdf-ae37-a0d328f53cc0 tempest-VolumesBackupsV39Test-263818218 None] deleted object: volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00004 in container: tempest-volumesbackupsv39test-backup-container-1880347674. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:39:29.206897 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-16c08104-43ea-4cdf-ae37-a0d328f53cc0 tempest-VolumesBackupsV39Test-263818218 None] deleted object: volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00005 in container: tempest-volumesbackupsv39test-backup-container-1880347674. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:39:29.229018 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-16c08104-43ea-4cdf-ae37-a0d328f53cc0 tempest-VolumesBackupsV39Test-263818218 None] deleted object: volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00006 in container: tempest-volumesbackupsv39test-backup-container-1880347674. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:39:29.252084 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-16c08104-43ea-4cdf-ae37-a0d328f53cc0 tempest-VolumesBackupsV39Test-263818218 None] deleted object: volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00007 in container: tempest-volumesbackupsv39test-backup-container-1880347674. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:39:29.273507 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-16c08104-43ea-4cdf-ae37-a0d328f53cc0 tempest-VolumesBackupsV39Test-263818218 None] deleted object: volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00008 in container: tempest-volumesbackupsv39test-backup-container-1880347674. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:39:29.296576 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-16c08104-43ea-4cdf-ae37-a0d328f53cc0 tempest-VolumesBackupsV39Test-263818218 None] deleted object: volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00009 in container: tempest-volumesbackupsv39test-backup-container-1880347674. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:39:29.318777 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-16c08104-43ea-4cdf-ae37-a0d328f53cc0 tempest-VolumesBackupsV39Test-263818218 None] deleted object: volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00010 in container: tempest-volumesbackupsv39test-backup-container-1880347674. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:39:29.338917 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-16c08104-43ea-4cdf-ae37-a0d328f53cc0 tempest-VolumesBackupsV39Test-263818218 None] deleted object: volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00011 in container: tempest-volumesbackupsv39test-backup-container-1880347674. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:39:29.359943 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-16c08104-43ea-4cdf-ae37-a0d328f53cc0 tempest-VolumesBackupsV39Test-263818218 None] deleted object: volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00012 in container: tempest-volumesbackupsv39test-backup-container-1880347674. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:39:29.379641 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-16c08104-43ea-4cdf-ae37-a0d328f53cc0 tempest-VolumesBackupsV39Test-263818218 None] deleted object: volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00013 in container: tempest-volumesbackupsv39test-backup-container-1880347674. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:39:29.403650 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-16c08104-43ea-4cdf-ae37-a0d328f53cc0 tempest-VolumesBackupsV39Test-263818218 None] deleted object: volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00014 in container: tempest-volumesbackupsv39test-backup-container-1880347674. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:39:29.424079 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-16c08104-43ea-4cdf-ae37-a0d328f53cc0 tempest-VolumesBackupsV39Test-263818218 None] deleted object: volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00015 in container: tempest-volumesbackupsv39test-backup-container-1880347674. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:39:29.444303 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-16c08104-43ea-4cdf-ae37-a0d328f53cc0 tempest-VolumesBackupsV39Test-263818218 None] deleted object: volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00016 in container: tempest-volumesbackupsv39test-backup-container-1880347674. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:39:29.465336 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-16c08104-43ea-4cdf-ae37-a0d328f53cc0 tempest-VolumesBackupsV39Test-263818218 None] deleted object: volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00017 in container: tempest-volumesbackupsv39test-backup-container-1880347674. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:39:29.491817 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-16c08104-43ea-4cdf-ae37-a0d328f53cc0 tempest-VolumesBackupsV39Test-263818218 None] deleted object: volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00018 in container: tempest-volumesbackupsv39test-backup-container-1880347674. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:39:29.514224 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-16c08104-43ea-4cdf-ae37-a0d328f53cc0 tempest-VolumesBackupsV39Test-263818218 None] deleted object: volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00019 in container: tempest-volumesbackupsv39test-backup-container-1880347674. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:39:29.540334 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-16c08104-43ea-4cdf-ae37-a0d328f53cc0 tempest-VolumesBackupsV39Test-263818218 None] deleted object: volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00020 in container: tempest-volumesbackupsv39test-backup-container-1880347674. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:39:29.560678 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-16c08104-43ea-4cdf-ae37-a0d328f53cc0 tempest-VolumesBackupsV39Test-263818218 None] deleted object: volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68-00021 in container: tempest-volumesbackupsv39test-backup-container-1880347674. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:39:29.581222 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-16c08104-43ea-4cdf-ae37-a0d328f53cc0 tempest-VolumesBackupsV39Test-263818218 None] deleted object: volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68_metadata in container: tempest-volumesbackupsv39test-backup-container-1880347674. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:39:29.605400 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-16c08104-43ea-4cdf-ae37-a0d328f53cc0 tempest-VolumesBackupsV39Test-263818218 None] deleted object: volume_437af98e-5b46-467f-8ffb-31218d021c7e/20260705033912/az_nova_backup_abd27258-b7aa-4d90-931f-2e1f16345e68_sha256file in container: tempest-volumesbackupsv39test-backup-container-1880347674. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:39:29.605538 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-16c08104-43ea-4cdf-ae37-a0d328f53cc0 tempest-VolumesBackupsV39Test-263818218 None] delete abd27258-b7aa-4d90-931f-2e1f16345e68 finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:39:29.657908 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-16c08104-43ea-4cdf-ae37-a0d328f53cc0 tempest-VolumesBackupsV39Test-263818218 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:39:29.675273 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-16c08104-43ea-4cdf-ae37-a0d328f53cc0 tempest-VolumesBackupsV39Test-263818218 None] Created reservations ['797b17b1-7fef-4764-80ab-d8ea2342f423', '6f25d533-83ed-4076-ac08-59ae5d4f9da6'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:39:29.696399 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-16c08104-43ea-4cdf-ae37-a0d328f53cc0 tempest-VolumesBackupsV39Test-263818218 None] Delete backup finished, backup abd27258-b7aa-4d90-931f-2e1f16345e68 deleted. Jul 05 03:39:39.692673 np0000004562 cinder-backup[101413]: DEBUG dbcounter [-] [101413] Writing DB stats cinder:SELECT=38,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=101413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:40:05.749786 np0000004562 cinder-backup[101413]: DEBUG dbcounter [-] [101413] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:40:11.766576 np0000004562 cinder-backup[101413]: DEBUG oslo_service.periodic_task [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:40:11.766975 np0000004562 cinder-backup[101413]: DEBUG cinder.manager [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Notifying Schedulers of capabilities ... {{(pid=101413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:40:16.380187 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Create backup started, backup: 1483c364-5a90-4bd3-a537-8a62a1c4246b volume: 72ec4cbc-8169-4a71-b5ad-563410978ad8. Jul 05 03:40:16.384594 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-1337263915',created_at=2026-07-05T03:40:16Z,data_timestamp=2026-07-05T03:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-242060030',encryption_key_id=None,fail_reason=None,host='np0000004562',id=1483c364-5a90-4bd3-a537-8a62a1c4246b,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='9ebf67ca50e54c89bb8084c855cb1e32',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='e89d8ef0122f41c999bbb4d9fd9d8712',volume_id=72ec4cbc-8169-4a71-b5ad-563410978ad8) Jul 05 03:40:16.450313 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_9ebf67ca50e54c89bb8084c855cb1e32 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:40:16.450526 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:40:16.450868 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:40:16.460283 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:40:16.482921 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:40:16.496307 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:40:16.496635 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:40:16.503678 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:40:16.505639 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fece:4a0c', 'fe80::4003:aff:fe73:5fc', 'fe80::f816:3eff:fef1:a5e7', 'fe80::f816:3eff:fe7d:7daa', 'fe80::c813:fdff:fe18:febe', 'fe80::f816:3eff:fed0:fb01', 'fe80::7447:8bff:fedd:a781', 'fe80::f816:3eff:fe32:6af1', 'fe80::c8e9:89ff:febf:bf90', 'fe80::f816:3eff:feed:52ee', 'fe80::689e:ddff:fe47:c424', 'fe80::f816:3eff:fe78:29ab', 'fe80::4871:a0ff:feb5:e1d', 'fe80::f816:3eff:fe03:899f', 'fe80::e075:aff:fed9:9a2e'] Jul 05 03:40:16.505988 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:40:16.506210 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:40:16.506571 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] <== get_connector_properties: return (55ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:40:17.010857 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:40:17.011320 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-98dcf1a6-6213-440d-abe9-126279c60c48', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '98dcf1a6-6213-440d-abe9-126279c60c48', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:40:17.011522 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:40:17.012071 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:40:17.012350 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-98dcf1a6-6213-440d-abe9-126279c60c48', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '98dcf1a6-6213-440d-abe9-126279c60c48', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:40:17.027158 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-98dcf1a6-6213-440d-abe9-126279c60c48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:40:17.027158 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-98dcf1a6-6213-440d-abe9-126279c60c48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:40:17.027333 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:40:17.040194 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:40:17.040194 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:40:17.052237 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-98dcf1a6-6213-440d-abe9-126279c60c48] added Jul 05 03:40:17.052237 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:40:17.052237 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:40:17.052237 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:40:17.052237 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:40:17.052237 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:40:17.052237 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:40:17.052510 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:40:17.052884 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0254(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:40:17.053131 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:40:18.054510 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-98dcf1a6-6213-440d-abe9-126279c60c48 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:40:18.066248 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:40:18.077501 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:40:18.097326 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7aa9d7fd-1ddd-4bc9-8dd7-61ed704a19dc (non-flash) Jul 05 03:40:18.097326 np0000004562 cinder-backup[101413]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7aa9d7fd-1ddd-4bc9-8dd7-61ed704a19dc (non-flash) Jul 05 03:40:18.097326 np0000004562 cinder-backup[101413]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:40:18.097326 np0000004562 cinder-backup[101413]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:40:18.097326 np0000004562 cinder-backup[101413]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:40:18.097326 np0000004562 cinder-backup[101413]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:40:18.097326 np0000004562 cinder-backup[101413]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:40:18.097326 np0000004562 cinder-backup[101413]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:40:18.097326 np0000004562 cinder-backup[101413]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72ec4cbc-8169-4a71-b5ad-563410978ad8 (non-flash) Jul 05 03:40:18.097326 np0000004562 cinder-backup[101413]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72ec4cbc-8169-4a71-b5ad-563410978ad8 (non-flash) Jul 05 03:40:18.097326 np0000004562 cinder-backup[101413]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:40:18.097326 np0000004562 cinder-backup[101413]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:40:18.097326 np0000004562 cinder-backup[101413]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:40:18.097326 np0000004562 cinder-backup[101413]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:40:18.097326 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:40:18.097911 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7aa9d7fd-1ddd-4bc9-8dd7-61ed704a19dc (non-flash) Jul 05 03:40:18.097911 np0000004562 cinder-backup[101413]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7aa9d7fd-1ddd-4bc9-8dd7-61ed704a19dc (non-flash) Jul 05 03:40:18.097911 np0000004562 cinder-backup[101413]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:40:18.097911 np0000004562 cinder-backup[101413]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:40:18.097911 np0000004562 cinder-backup[101413]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:40:18.097911 np0000004562 cinder-backup[101413]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:40:18.097911 np0000004562 cinder-backup[101413]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:40:18.097911 np0000004562 cinder-backup[101413]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:40:18.097911 np0000004562 cinder-backup[101413]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72ec4cbc-8169-4a71-b5ad-563410978ad8 (non-flash) Jul 05 03:40:18.097911 np0000004562 cinder-backup[101413]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72ec4cbc-8169-4a71-b5ad-563410978ad8 (non-flash) Jul 05 03:40:18.097911 np0000004562 cinder-backup[101413]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:40:18.097911 np0000004562 cinder-backup[101413]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:40:18.097911 np0000004562 cinder-backup[101413]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:40:18.097911 np0000004562 cinder-backup[101413]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:40:18.097911 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:40:18.143131 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-98dcf1a6-6213-440d-abe9-126279c60c48, portal: 192.168.40.100,3260] Jul 05 03:40:18.143131 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-98dcf1a6-6213-440d-abe9-126279c60c48, portal: 192.168.40.100,3260] successful. Jul 05 03:40:18.143131 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:40:18.153982 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:40:18.175339 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7aa9d7fd-1ddd-4bc9-8dd7-61ed704a19dc (non-flash) Jul 05 03:40:18.175339 np0000004562 cinder-backup[101413]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7aa9d7fd-1ddd-4bc9-8dd7-61ed704a19dc (non-flash) Jul 05 03:40:18.175339 np0000004562 cinder-backup[101413]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:40:18.175339 np0000004562 cinder-backup[101413]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:40:18.175339 np0000004562 cinder-backup[101413]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:40:18.175339 np0000004562 cinder-backup[101413]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:40:18.175339 np0000004562 cinder-backup[101413]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:40:18.175339 np0000004562 cinder-backup[101413]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:40:18.175339 np0000004562 cinder-backup[101413]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72ec4cbc-8169-4a71-b5ad-563410978ad8 (non-flash) Jul 05 03:40:18.175339 np0000004562 cinder-backup[101413]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72ec4cbc-8169-4a71-b5ad-563410978ad8 (non-flash) Jul 05 03:40:18.175339 np0000004562 cinder-backup[101413]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98dcf1a6-6213-440d-abe9-126279c60c48 (non-flash) Jul 05 03:40:18.175339 np0000004562 cinder-backup[101413]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:40:18.175339 np0000004562 cinder-backup[101413]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:40:18.175339 np0000004562 cinder-backup[101413]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:40:18.175339 np0000004562 cinder-backup[101413]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:40:18.175339 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:40:18.175759 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7aa9d7fd-1ddd-4bc9-8dd7-61ed704a19dc (non-flash) Jul 05 03:40:18.175759 np0000004562 cinder-backup[101413]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7aa9d7fd-1ddd-4bc9-8dd7-61ed704a19dc (non-flash) Jul 05 03:40:18.175759 np0000004562 cinder-backup[101413]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:40:18.175759 np0000004562 cinder-backup[101413]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:40:18.175759 np0000004562 cinder-backup[101413]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:40:18.175759 np0000004562 cinder-backup[101413]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:40:18.175759 np0000004562 cinder-backup[101413]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:40:18.175759 np0000004562 cinder-backup[101413]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:40:18.175759 np0000004562 cinder-backup[101413]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72ec4cbc-8169-4a71-b5ad-563410978ad8 (non-flash) Jul 05 03:40:18.175759 np0000004562 cinder-backup[101413]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72ec4cbc-8169-4a71-b5ad-563410978ad8 (non-flash) Jul 05 03:40:18.175759 np0000004562 cinder-backup[101413]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98dcf1a6-6213-440d-abe9-126279c60c48 (non-flash) Jul 05 03:40:18.175759 np0000004562 cinder-backup[101413]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:40:18.175759 np0000004562 cinder-backup[101413]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:40:18.175759 np0000004562 cinder-backup[101413]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:40:18.175759 np0000004562 cinder-backup[101413]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:40:18.175759 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:40:18.176014 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-98dcf1a6-6213-440d-abe9-126279c60c48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:40:18.176099 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:40:18.177452 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] HCTL ('19', '-', '-', 0) found on session 114 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:40:18.177616 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Scanning host 19 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:40:18.202250 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Searching for a device in session 114 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:40:18.202250 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-98dcf1a6-6213-440d-abe9-126279c60c48', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '98dcf1a6-6213-440d-abe9-126279c60c48', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:40:19.203310 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.191s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:40:19.203804 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] <== connect_volume: return (2191ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799129', 'path': '/dev/sdn'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:40:19.203909 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdn {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:40:19.231744 np0000004562 sudo[134999]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdn Jul 05 03:40:19.232567 np0000004562 sudo[134999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:40:19.536478 np0000004562 sudo[134999]: pam_unix(sudo:session): session closed for user root Jul 05 03:40:19.538849 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdn" returned: 0 in 0.334s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:40:19.576456 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:40:19.582695 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] _create_container started, container: tempest-volumesbackupstest-backup-container-1337263915,backup: 1483c364-5a90-4bd3-a537-8a62a1c4246b. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:40:19.714851 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] generate_object_name_prefix: volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:40:19.722562 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] starting backup of volume: 72ec4cbc-8169-4a71-b5ad-563410978ad8, volume size: 1073741824, object names prefix volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:40:19.955825 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:40:20.225091 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:40:20.225091 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:40:20.340845 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:40:20.341309 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:40:20.569160 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:40:20.846078 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:40:20.847187 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:40:20.962371 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:40:20.962371 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:40:21.198101 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:40:21.465905 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:40:21.466583 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:40:21.574235 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:40:21.574395 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:40:21.786930 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:40:22.049232 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:40:22.049367 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:40:22.149318 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:40:22.149481 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:40:22.348946 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:40:22.592228 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:40:22.592507 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:40:22.696818 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:40:22.696992 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:40:22.879599 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:40:23.149170 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:40:23.149315 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:40:23.251095 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:40:23.251261 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:40:23.466935 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:40:23.754086 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:40:23.754539 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:40:23.870832 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:40:23.870966 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:40:24.074116 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:40:24.314197 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:40:24.314341 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:40:24.416029 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:40:24.416239 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:40:24.634368 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:40:24.911801 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:40:24.912111 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:40:25.018848 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:40:25.018848 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:40:25.216510 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:40:25.505624 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:40:25.505624 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:40:25.612793 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:40:25.612793 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:40:25.823847 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:40:26.065611 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:40:26.065979 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:40:26.172691 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:40:26.172921 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:40:26.371797 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:40:26.623570 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:40:26.623770 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:40:26.742465 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:40:26.742674 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:40:26.946196 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:40:27.195011 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:40:27.195487 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:40:27.296539 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:40:27.296821 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:40:27.535253 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:40:27.803189 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:40:27.803350 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:40:27.916783 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:40:27.916938 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:40:28.148741 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:40:28.414836 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:40:28.415208 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:40:28.544241 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:40:28.544503 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:40:28.795975 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:40:29.060617 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:40:29.060836 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:40:29.169510 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:40:29.169686 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:40:29.380616 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:40:29.652339 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:40:29.652827 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:40:29.757043 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:40:29.757043 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:40:29.989802 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:40:30.255661 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:40:30.255856 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:40:30.367685 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:40:30.367887 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:40:30.591544 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:40:30.847296 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:40:30.847826 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:40:30.951837 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:40:30.952084 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:40:31.171894 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:40:31.420246 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:40:31.420448 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:40:31.527404 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:40:31.527559 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:40:31.633856 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:40:31.759745 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:40:31.759930 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:40:31.823665 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:40:31.823872 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:40:31.831676 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:40:31.837916 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:40:31.838105 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:40:31.842514 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:40:31.842648 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:40:31.846178 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:40:31.846478 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-1337263915, sha256file filename: volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:40:31.910462 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:40:31.911367 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-1337263915, metadata filename: volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:40:31.943893 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "1483c364-5a90-4bd3-a537-8a62a1c4246b",\n "backup_name": "tempest-VolumesBackupsTest-Backup-242060030",\n "created_at": "2026-07-05 03:40:16+00:00",\n "objects": [\n {\n "volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "72ec4cbc-8169-4a71-b5ad-563410978ad8",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"72ec4cbc-8169-4a71-b5ad-563410978ad8\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"e89d8ef0122f41c999bbb4d9fd9d8712\\", \\"project_id\\": \\"9ebf67ca50e54c89bb8084c855cb1e32\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"attached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:39:12.000000\\", \\"launched_at\\": \\"2026-07-05T03:39:13.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1445704768\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"in-use\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:39:12.000000\\", \\"updated_at\\": \\"2026-07-05T03:40:16.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:40:31.955672 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] backup 1483c364-5a90-4bd3-a537-8a62a1c4246b finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:40:32.110829 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdn {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:40:32.140935 np0000004562 sudo[135668]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdn Jul 05 03:40:32.141930 np0000004562 sudo[135668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:40:32.515426 np0000004562 sudo[135668]: pam_unix(sudo:session): session closed for user root Jul 05 03:40:32.518093 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdn" returned: 0 in 0.407s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:40:32.518645 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-98dcf1a6-6213-440d-abe9-126279c60c48', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '98dcf1a6-6213-440d-abe9-126279c60c48', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799129', 'path': '/dev/sdn'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:40:32.518917 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:40:32.519578 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:40:32.520066 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-98dcf1a6-6213-440d-abe9-126279c60c48', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '98dcf1a6-6213-440d-abe9-126279c60c48', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-98dcf1a6-6213-440d-abe9-126279c60c48 Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-72ec4cbc-8169-4a71-b5ad-563410978ad8 Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:40:32.538505 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:40:32.539553 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:40:32.539553 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:40:32.539553 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:40:32.539553 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-98dcf1a6-6213-440d-abe9-126279c60c48', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:40:32.573038 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:40:32.573038 np0000004562 cinder-backup[101413]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:40:32.573038 np0000004562 cinder-backup[101413]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:40:32.573038 np0000004562 cinder-backup[101413]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:40:32.573038 np0000004562 cinder-backup[101413]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:40:32.573038 np0000004562 cinder-backup[101413]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:40:32.573038 np0000004562 cinder-backup[101413]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72ec4cbc-8169-4a71-b5ad-563410978ad8 (non-flash) Jul 05 03:40:32.573038 np0000004562 cinder-backup[101413]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72ec4cbc-8169-4a71-b5ad-563410978ad8 (non-flash) Jul 05 03:40:32.573038 np0000004562 cinder-backup[101413]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98dcf1a6-6213-440d-abe9-126279c60c48 (non-flash) Jul 05 03:40:32.573038 np0000004562 cinder-backup[101413]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:40:32.573038 np0000004562 cinder-backup[101413]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:40:32.573038 np0000004562 cinder-backup[101413]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:40:32.573038 np0000004562 cinder-backup[101413]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:40:32.573038 np0000004562 cinder-backup[101413]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:40:32.573038 np0000004562 cinder-backup[101413]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:40:32.573038 np0000004562 cinder-backup[101413]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:40:32.573038 np0000004562 cinder-backup[101413]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:40:32.573038 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:40:32.573629 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:40:32.573629 np0000004562 cinder-backup[101413]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:40:32.573629 np0000004562 cinder-backup[101413]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:40:32.573629 np0000004562 cinder-backup[101413]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:40:32.573629 np0000004562 cinder-backup[101413]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:40:32.573629 np0000004562 cinder-backup[101413]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:40:32.573629 np0000004562 cinder-backup[101413]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72ec4cbc-8169-4a71-b5ad-563410978ad8 (non-flash) Jul 05 03:40:32.573629 np0000004562 cinder-backup[101413]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72ec4cbc-8169-4a71-b5ad-563410978ad8 (non-flash) Jul 05 03:40:32.573629 np0000004562 cinder-backup[101413]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98dcf1a6-6213-440d-abe9-126279c60c48 (non-flash) Jul 05 03:40:32.573629 np0000004562 cinder-backup[101413]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:40:32.573629 np0000004562 cinder-backup[101413]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:40:32.573629 np0000004562 cinder-backup[101413]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:40:32.573629 np0000004562 cinder-backup[101413]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:40:32.573629 np0000004562 cinder-backup[101413]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:40:32.573629 np0000004562 cinder-backup[101413]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:40:32.573629 np0000004562 cinder-backup[101413]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:40:32.573629 np0000004562 cinder-backup[101413]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:40:32.573629 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:40:32.573629 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74', '105'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4', '106'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2', '108'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2', '109'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72ec4cbc-8169-4a71-b5ad-563410978ad8', '112'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72ec4cbc-8169-4a71-b5ad-563410978ad8', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-98dcf1a6-6213-440d-abe9-126279c60c48', '114'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6', '115'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2', '117'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2', '118'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce', '98'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce', '99')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:40:32.573629 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-98dcf1a6-6213-440d-abe9-126279c60c48, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-98dcf1a6-6213-440d-abe9-126279c60c48', '114')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:40:32.575187 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Resulting device map defaultdict(. at 0x72a48e9a59e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-98dcf1a6-6213-440d-abe9-126279c60c48'): ({'sdn'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:40:32.575401 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Removing single pathed devices sdn {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:40:32.586615 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Flushing IO for device /dev/sdn {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:40:32.595930 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:40:32.642405 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Checking to see if SCSI volumes sdn have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:40:32.642630 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] SCSI volumes sdn have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:40:32.645656 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Checking to see if device paths {'sdn'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:40:32.657511 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Device paths {'sdn'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:40:32.657793 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-98dcf1a6-6213-440d-abe9-126279c60c48')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:40:32.669725 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:40:32.710408 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 114, target: iqn.2023-03.storpool.com:os--volume-98dcf1a6-6213-440d-abe9-126279c60c48, portal: 192.168.40.100,3260] Jul 05 03:40:32.710408 np0000004562 cinder-backup[101413]: Logout of [sid: 114, target: iqn.2023-03.storpool.com:os--volume-98dcf1a6-6213-440d-abe9-126279c60c48, portal: 192.168.40.100,3260] successful. Jul 05 03:40:32.710408 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:40:32.743486 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:40:32.747154 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.227s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:40:32.747427 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] <== disconnect_volume: return (228ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:40:33.795916 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-9471a019-a1c8-484e-8d9a-8f44e18816d3 tempest-VolumesBackupsTest-551128076 None] Create backup finished. backup: 1483c364-5a90-4bd3-a537-8a62a1c4246b. Jul 05 03:40:33.922050 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-f6724603-1e82-4b96-aefd-9d5959d05bf1 tempest-VolumesBackupsTest-551128076 None] Delete backup started, backup: 1483c364-5a90-4bd3-a537-8a62a1c4246b. Jul 05 03:40:33.927873 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-f6724603-1e82-4b96-aefd-9d5959d05bf1 tempest-VolumesBackupsTest-551128076 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_9ebf67ca50e54c89bb8084c855cb1e32 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:40:33.928292 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-f6724603-1e82-4b96-aefd-9d5959d05bf1 tempest-VolumesBackupsTest-551128076 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:40:33.928597 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f6724603-1e82-4b96-aefd-9d5959d05bf1 tempest-VolumesBackupsTest-551128076 None] delete started, backup: 1483c364-5a90-4bd3-a537-8a62a1c4246b, container: tempest-volumesbackupstest-backup-container-1337263915, prefix: volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:40:33.975995 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f6724603-1e82-4b96-aefd-9d5959d05bf1 tempest-VolumesBackupsTest-551128076 None] generated object list: ['volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00001', 'volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00002', 'volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00003', 'volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00004', 'volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00005', 'volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00006', 'volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00007', 'volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00008', 'volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00009', 'volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00010', 'volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00011', 'volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00012', 'volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00013', 'volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00014', 'volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00015', 'volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00016', 'volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00017', 'volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00018', 'volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00019', 'volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00020', 'volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00021', 'volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b_metadata', 'volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:40:33.996958 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f6724603-1e82-4b96-aefd-9d5959d05bf1 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00001 in container: tempest-volumesbackupstest-backup-container-1337263915. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:40:34.021748 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f6724603-1e82-4b96-aefd-9d5959d05bf1 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00002 in container: tempest-volumesbackupstest-backup-container-1337263915. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:40:34.041165 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f6724603-1e82-4b96-aefd-9d5959d05bf1 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00003 in container: tempest-volumesbackupstest-backup-container-1337263915. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:40:34.066473 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f6724603-1e82-4b96-aefd-9d5959d05bf1 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00004 in container: tempest-volumesbackupstest-backup-container-1337263915. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:40:34.087367 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f6724603-1e82-4b96-aefd-9d5959d05bf1 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00005 in container: tempest-volumesbackupstest-backup-container-1337263915. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:40:34.106112 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f6724603-1e82-4b96-aefd-9d5959d05bf1 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00006 in container: tempest-volumesbackupstest-backup-container-1337263915. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:40:34.125420 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f6724603-1e82-4b96-aefd-9d5959d05bf1 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00007 in container: tempest-volumesbackupstest-backup-container-1337263915. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:40:34.143466 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f6724603-1e82-4b96-aefd-9d5959d05bf1 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00008 in container: tempest-volumesbackupstest-backup-container-1337263915. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:40:34.165431 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f6724603-1e82-4b96-aefd-9d5959d05bf1 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00009 in container: tempest-volumesbackupstest-backup-container-1337263915. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:40:34.189455 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f6724603-1e82-4b96-aefd-9d5959d05bf1 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00010 in container: tempest-volumesbackupstest-backup-container-1337263915. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:40:34.225775 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f6724603-1e82-4b96-aefd-9d5959d05bf1 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00011 in container: tempest-volumesbackupstest-backup-container-1337263915. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:40:34.249516 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f6724603-1e82-4b96-aefd-9d5959d05bf1 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00012 in container: tempest-volumesbackupstest-backup-container-1337263915. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:40:34.270371 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f6724603-1e82-4b96-aefd-9d5959d05bf1 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00013 in container: tempest-volumesbackupstest-backup-container-1337263915. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:40:34.296050 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f6724603-1e82-4b96-aefd-9d5959d05bf1 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00014 in container: tempest-volumesbackupstest-backup-container-1337263915. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:40:34.316565 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f6724603-1e82-4b96-aefd-9d5959d05bf1 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00015 in container: tempest-volumesbackupstest-backup-container-1337263915. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:40:34.340860 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f6724603-1e82-4b96-aefd-9d5959d05bf1 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00016 in container: tempest-volumesbackupstest-backup-container-1337263915. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:40:34.365416 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f6724603-1e82-4b96-aefd-9d5959d05bf1 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00017 in container: tempest-volumesbackupstest-backup-container-1337263915. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:40:34.386076 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f6724603-1e82-4b96-aefd-9d5959d05bf1 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00018 in container: tempest-volumesbackupstest-backup-container-1337263915. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:40:34.407787 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f6724603-1e82-4b96-aefd-9d5959d05bf1 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00019 in container: tempest-volumesbackupstest-backup-container-1337263915. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:40:34.430340 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f6724603-1e82-4b96-aefd-9d5959d05bf1 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00020 in container: tempest-volumesbackupstest-backup-container-1337263915. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:40:34.451973 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f6724603-1e82-4b96-aefd-9d5959d05bf1 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b-00021 in container: tempest-volumesbackupstest-backup-container-1337263915. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:40:34.474403 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f6724603-1e82-4b96-aefd-9d5959d05bf1 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b_metadata in container: tempest-volumesbackupstest-backup-container-1337263915. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:40:34.496094 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f6724603-1e82-4b96-aefd-9d5959d05bf1 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_72ec4cbc-8169-4a71-b5ad-563410978ad8/20260705034019/az_nova_backup_1483c364-5a90-4bd3-a537-8a62a1c4246b_sha256file in container: tempest-volumesbackupstest-backup-container-1337263915. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:40:34.496297 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f6724603-1e82-4b96-aefd-9d5959d05bf1 tempest-VolumesBackupsTest-551128076 None] delete 1483c364-5a90-4bd3-a537-8a62a1c4246b finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:40:34.532267 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-f6724603-1e82-4b96-aefd-9d5959d05bf1 tempest-VolumesBackupsTest-551128076 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:40:34.546248 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-f6724603-1e82-4b96-aefd-9d5959d05bf1 tempest-VolumesBackupsTest-551128076 None] Created reservations ['51dd3735-fd1a-4abb-993e-1b9cc535ddea', '1fad9620-de0b-487a-9c86-af83046492f8'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:40:34.563782 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-f6724603-1e82-4b96-aefd-9d5959d05bf1 tempest-VolumesBackupsTest-551128076 None] Delete backup finished, backup 1483c364-5a90-4bd3-a537-8a62a1c4246b deleted. Jul 05 03:40:44.560467 np0000004562 cinder-backup[101413]: DEBUG dbcounter [-] [101413] Writing DB stats cinder:SELECT=41,cinder:UPDATE=12,cinder:INSERT=2 {{(pid=101413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:40:48.722193 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Create backup started, backup: 200bfbae-9329-436b-8f6f-8267b7226aff volume: 3d432c0f-6d42-4549-87fb-1659ec285b6c. Jul 05 03:40:48.730212 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-854621895',created_at=2026-07-05T03:40:48Z,data_timestamp=2026-07-05T03:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1308659195',encryption_key_id=None,fail_reason=None,host='np0000004562',id=200bfbae-9329-436b-8f6f-8267b7226aff,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='9ebf67ca50e54c89bb8084c855cb1e32',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='e89d8ef0122f41c999bbb4d9fd9d8712',volume_id=3d432c0f-6d42-4549-87fb-1659ec285b6c) Jul 05 03:40:48.751460 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_9ebf67ca50e54c89bb8084c855cb1e32 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:40:48.751773 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:40:48.752150 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:40:48.762727 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:40:48.797602 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:40:48.813241 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:40:48.814747 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:40:48.823104 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:40:48.825044 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fece:4a0c', 'fe80::4003:aff:fe73:5fc', 'fe80::f816:3eff:fef1:a5e7', 'fe80::f816:3eff:fe7d:7daa', 'fe80::c813:fdff:fe18:febe', 'fe80::f816:3eff:fe32:6af1', 'fe80::c8e9:89ff:febf:bf90', 'fe80::f816:3eff:fe78:29ab', 'fe80::4871:a0ff:feb5:e1d', 'fe80::f816:3eff:fe03:899f', 'fe80::e075:aff:fed9:9a2e', 'fe80::f816:3eff:feba:8469', 'fe80::f816:3eff:fe69:1b49', 'fe80::f816:3eff:fe2d:3847', 'fe80::c12:3eff:fe92:c55e'] Jul 05 03:40:48.825044 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:40:48.826192 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:40:48.826192 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] <== get_connector_properties: return (72ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:40:49.329976 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:40:49.330326 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3d432c0f-6d42-4549-87fb-1659ec285b6c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3d432c0f-6d42-4549-87fb-1659ec285b6c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:40:49.330516 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:40:49.331090 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:40:49.331395 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3d432c0f-6d42-4549-87fb-1659ec285b6c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3d432c0f-6d42-4549-87fb-1659ec285b6c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:40:49.341624 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3d432c0f-6d42-4549-87fb-1659ec285b6c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:40:49.342141 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3d432c0f-6d42-4549-87fb-1659ec285b6c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:40:49.342439 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:40:49.353062 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:40:49.353062 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:40:49.363294 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3d432c0f-6d42-4549-87fb-1659ec285b6c] added Jul 05 03:40:49.363294 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:40:49.363294 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:40:49.363294 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:40:49.363294 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:40:49.363294 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:40:49.363294 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:40:49.363589 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:40:49.364108 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0215(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:40:49.364290 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:40:50.365788 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-3d432c0f-6d42-4549-87fb-1659ec285b6c Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:40:50.380129 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:40:50.393878 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-396cc1ad-ea0f-43f7-8fb3-d7bac15bc5a9 (non-flash) Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-396cc1ad-ea0f-43f7-8fb3-d7bac15bc5a9 (non-flash) Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-396cc1ad-ea0f-43f7-8fb3-d7bac15bc5a9 (non-flash) Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-396cc1ad-ea0f-43f7-8fb3-d7bac15bc5a9 (non-flash) Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:40:50.418337 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:40:50.474412 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3d432c0f-6d42-4549-87fb-1659ec285b6c, portal: 192.168.40.100,3260] Jul 05 03:40:50.474412 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3d432c0f-6d42-4549-87fb-1659ec285b6c, portal: 192.168.40.100,3260] successful. Jul 05 03:40:50.474412 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:40:50.488004 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:40:50.509005 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:40:50.509005 np0000004562 cinder-backup[101413]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:40:50.509005 np0000004562 cinder-backup[101413]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:40:50.509005 np0000004562 cinder-backup[101413]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:40:50.509005 np0000004562 cinder-backup[101413]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:40:50.509005 np0000004562 cinder-backup[101413]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:40:50.509005 np0000004562 cinder-backup[101413]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:40:50.509005 np0000004562 cinder-backup[101413]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:40:50.509005 np0000004562 cinder-backup[101413]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:40:50.509005 np0000004562 cinder-backup[101413]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:40:50.509005 np0000004562 cinder-backup[101413]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-396cc1ad-ea0f-43f7-8fb3-d7bac15bc5a9 (non-flash) Jul 05 03:40:50.509005 np0000004562 cinder-backup[101413]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-396cc1ad-ea0f-43f7-8fb3-d7bac15bc5a9 (non-flash) Jul 05 03:40:50.509005 np0000004562 cinder-backup[101413]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d432c0f-6d42-4549-87fb-1659ec285b6c (non-flash) Jul 05 03:40:50.509005 np0000004562 cinder-backup[101413]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:40:50.509005 np0000004562 cinder-backup[101413]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:40:50.509005 np0000004562 cinder-backup[101413]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:40:50.509005 np0000004562 cinder-backup[101413]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:40:50.509005 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:40:50.511412 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:40:50.511412 np0000004562 cinder-backup[101413]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:40:50.511412 np0000004562 cinder-backup[101413]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:40:50.511412 np0000004562 cinder-backup[101413]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:40:50.511412 np0000004562 cinder-backup[101413]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:40:50.511412 np0000004562 cinder-backup[101413]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:40:50.511412 np0000004562 cinder-backup[101413]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:40:50.511412 np0000004562 cinder-backup[101413]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:40:50.511412 np0000004562 cinder-backup[101413]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:40:50.511412 np0000004562 cinder-backup[101413]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:40:50.511412 np0000004562 cinder-backup[101413]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-396cc1ad-ea0f-43f7-8fb3-d7bac15bc5a9 (non-flash) Jul 05 03:40:50.511412 np0000004562 cinder-backup[101413]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-396cc1ad-ea0f-43f7-8fb3-d7bac15bc5a9 (non-flash) Jul 05 03:40:50.511412 np0000004562 cinder-backup[101413]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d432c0f-6d42-4549-87fb-1659ec285b6c (non-flash) Jul 05 03:40:50.511412 np0000004562 cinder-backup[101413]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:40:50.511412 np0000004562 cinder-backup[101413]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eefa3f4b-0b2c-401d-9dad-a74a121b3d2a (non-flash) Jul 05 03:40:50.511412 np0000004562 cinder-backup[101413]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:40:50.511412 np0000004562 cinder-backup[101413]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:40:50.511412 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:40:50.511412 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3d432c0f-6d42-4549-87fb-1659ec285b6c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:40:50.511412 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:40:50.513435 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] HCTL ('19', '-', '-', 0) found on session 121 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:40:50.513435 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Scanning host 19 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:40:50.530279 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Searching for a device in session 121 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:40:50.530279 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3d432c0f-6d42-4549-87fb-1659ec285b6c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3d432c0f-6d42-4549-87fb-1659ec285b6c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:40:51.534570 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.203s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:40:51.536735 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] <== connect_volume: return (2204ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799132', 'path': '/dev/sdn'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:40:51.536735 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdn {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:40:51.553830 np0000004562 sudo[136172]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdn Jul 05 03:40:51.554470 np0000004562 sudo[136172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:40:51.870735 np0000004562 sudo[136172]: pam_unix(sudo:session): session closed for user root Jul 05 03:40:51.872684 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdn" returned: 0 in 0.336s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:40:51.910411 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:40:51.917733 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] _create_container started, container: tempest-volumesbackupstest-backup-container-854621895,backup: 200bfbae-9329-436b-8f6f-8267b7226aff. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:40:51.977550 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] generate_object_name_prefix: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:40:51.981990 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] starting backup of volume: 3d432c0f-6d42-4549-87fb-1659ec285b6c, volume size: 1073741824, object names prefix volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:40:52.166757 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:40:52.939745 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 19825286 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:40:52.940356 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:40:53.218342 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00001: 82571f7121cb9475563edde615e4e4df {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:40:53.218626 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:40:53.415238 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:40:53.678295 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:40:53.678503 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:40:53.783077 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:40:53.783227 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:40:53.998658 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:40:54.284519 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 1362154 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:40:54.284630 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:40:54.396021 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00003: a35891500449df17e893f84bd88472fb {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:40:54.396127 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:40:54.600567 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:40:54.871590 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:40:54.871810 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:40:55.532874 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:40:55.532874 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:40:55.532874 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:40:55.532874 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:40:55.532874 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:40:55.575003 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:40:55.575208 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:40:55.785383 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:40:56.035798 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:40:56.035916 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:40:56.139082 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:40:56.139241 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:40:56.325603 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:40:56.572352 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:40:56.572804 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:40:56.681735 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:40:56.681912 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:40:56.880803 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:40:57.145074 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:40:57.145246 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:40:57.252189 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:40:57.252422 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:40:57.444803 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:40:57.708581 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:40:57.708581 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:40:57.823566 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:40:57.823566 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:40:58.052472 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:40:58.315392 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:40:58.315613 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:40:58.425747 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:40:58.425870 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:40:58.622580 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:40:58.885883 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:40:58.886465 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:40:58.995765 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:40:58.996015 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:40:59.190234 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:40:59.434012 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:40:59.434153 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:40:59.543668 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:40:59.544275 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:40:59.739015 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:41:00.008317 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:41:00.008683 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:41:00.128012 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:41:00.128181 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:41:00.328168 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:41:00.575087 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:41:00.575303 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:41:00.686195 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:41:00.686358 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:41:00.895219 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:41:01.174889 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:41:01.174889 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:41:01.277307 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:41:01.277481 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:41:01.501387 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:41:01.743765 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:41:01.743934 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:41:01.861954 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:41:01.863358 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:41:02.060178 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:41:02.313553 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:41:02.313553 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:41:02.419854 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:41:02.419854 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:41:02.603794 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:41:02.853776 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:41:02.853776 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:41:02.963289 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:41:02.963687 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:41:03.204023 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:41:03.471251 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:41:03.471632 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:41:03.588878 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:41:03.589068 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:41:03.789544 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:41:04.059567 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:41:04.059706 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:41:04.168993 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:41:04.169148 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:41:04.280464 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:41:04.403895 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:41:04.403895 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:41:04.466320 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:41:04.466561 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:41:04.475333 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:41:04.481392 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:41:04.481586 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:41:04.486275 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:41:04.486531 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:41:04.491148 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Completed fetching metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:145}} Jul 05 03:41:04.491148 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-854621895, sha256file filename: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:41:04.548168 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:41:04.548871 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-854621895, metadata filename: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:41:04.572617 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "200bfbae-9329-436b-8f6f-8267b7226aff",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1308659195",\n "created_at": "2026-07-05 03:40:49+00:00",\n "objects": [\n {\n "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "82571f7121cb9475563edde615e4e4df",\n "offset": 0\n }\n },\n {\n "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "a35891500449df17e893f84bd88472fb",\n "offset": 104857600\n }\n },\n {\n "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "3d432c0f-6d42-4549-87fb-1659ec285b6c",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"3d432c0f-6d42-4549-87fb-1659ec285b6c\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"e89d8ef0122f41c999bbb4d9fd9d8712\\", \\"project_id\\": \\"9ebf67ca50e54c89bb8084c855cb1e32\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:40:48.000000\\", \\"launched_at\\": \\"2026-07-05T03:40:48.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-418611836\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": true, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:40:47.000000\\", \\"updated_at\\": \\"2026-07-05T03:40:49.000000\\"}, \\"volume-glance-metadata\\": {\\"hw_rng_model\\": \\"virtio\\", \\"os_glance_failed_import\\": \\"\\", \\"os_glance_importing_to_stores\\": \\"\\", \\"owner_specified.openstack.md5\\": \\"\\", \\"owner_specified.openstack.object\\": \\"images/cirros-0.6.3-x86_64-disk\\", \\"owner_specified.openstack.sha256\\": \\"\\", \\"image_id\\": \\"0c8fa207-3de5-4489-a2c5-f4cc8559edb8\\", \\"image_name\\": \\"cirros-0.6.3-x86_64-disk\\", \\"checksum\\": \\"87617e24a5e30cb3b87fda8c0764838f\\", \\"container_format\\": \\"bare\\", \\"disk_format\\": \\"qcow2\\", \\"min_disk\\": \\"0\\", \\"min_ram\\": \\"0\\", \\"size\\": \\"21692416\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:41:04.578640 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] backup 200bfbae-9329-436b-8f6f-8267b7226aff finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:41:04.701274 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdn {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:41:04.717531 np0000004562 sudo[136509]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdn Jul 05 03:41:04.718147 np0000004562 sudo[136509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:41:05.019561 np0000004562 sudo[136509]: pam_unix(sudo:session): session closed for user root Jul 05 03:41:05.021521 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdn" returned: 0 in 0.320s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:41:05.022128 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3d432c0f-6d42-4549-87fb-1659ec285b6c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3d432c0f-6d42-4549-87fb-1659ec285b6c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799132', 'path': '/dev/sdn'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:41:05.022310 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:41:05.022778 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:41:05.023133 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3d432c0f-6d42-4549-87fb-1659ec285b6c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3d432c0f-6d42-4549-87fb-1659ec285b6c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-3d432c0f-6d42-4549-87fb-1659ec285b6c Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:41:05.035016 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:41:05.035822 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:41:05.035822 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:41:05.035822 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:41:05.035822 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d432c0f-6d42-4549-87fb-1659ec285b6c', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:41:05.065041 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:41:05.065041 np0000004562 cinder-backup[101413]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:41:05.065041 np0000004562 cinder-backup[101413]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:41:05.065041 np0000004562 cinder-backup[101413]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:41:05.065041 np0000004562 cinder-backup[101413]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:41:05.065041 np0000004562 cinder-backup[101413]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:41:05.065041 np0000004562 cinder-backup[101413]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:05.065041 np0000004562 cinder-backup[101413]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:05.065041 np0000004562 cinder-backup[101413]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:41:05.065041 np0000004562 cinder-backup[101413]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:41:05.065041 np0000004562 cinder-backup[101413]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d432c0f-6d42-4549-87fb-1659ec285b6c (non-flash) Jul 05 03:41:05.065041 np0000004562 cinder-backup[101413]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:05.065041 np0000004562 cinder-backup[101413]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:05.065041 np0000004562 cinder-backup[101413]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:05.065041 np0000004562 cinder-backup[101413]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:05.065041 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:41:05.065439 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:41:05.065439 np0000004562 cinder-backup[101413]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:41:05.065439 np0000004562 cinder-backup[101413]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:41:05.065439 np0000004562 cinder-backup[101413]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:41:05.065439 np0000004562 cinder-backup[101413]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:41:05.065439 np0000004562 cinder-backup[101413]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:41:05.065439 np0000004562 cinder-backup[101413]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:05.065439 np0000004562 cinder-backup[101413]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:05.065439 np0000004562 cinder-backup[101413]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:41:05.065439 np0000004562 cinder-backup[101413]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:41:05.065439 np0000004562 cinder-backup[101413]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d432c0f-6d42-4549-87fb-1659ec285b6c (non-flash) Jul 05 03:41:05.065439 np0000004562 cinder-backup[101413]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:05.065439 np0000004562 cinder-backup[101413]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:05.065439 np0000004562 cinder-backup[101413]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:05.065439 np0000004562 cinder-backup[101413]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:05.065439 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:41:05.065439 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74', '105'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4', '106'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2', '108'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2', '109'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6', '115'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2', '117'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2', '118'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d432c0f-6d42-4549-87fb-1659ec285b6c', '121'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390', '122'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390', '123'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce', '98'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce', '99')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:41:05.065792 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3d432c0f-6d42-4549-87fb-1659ec285b6c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d432c0f-6d42-4549-87fb-1659ec285b6c', '121')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:41:05.066777 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Resulting device map defaultdict(. at 0x72a46fd12200>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d432c0f-6d42-4549-87fb-1659ec285b6c'): ({'sdn'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:41:05.067011 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Removing single pathed devices sdn {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:41:05.077416 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Flushing IO for device /dev/sdn {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:41:05.085279 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:41:05.126095 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Checking to see if SCSI volumes sdn have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:41:05.126266 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] SCSI volumes sdn have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:41:05.127866 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Checking to see if device paths {'sdn'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:41:05.137280 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Device paths {'sdn'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:41:05.137499 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d432c0f-6d42-4549-87fb-1659ec285b6c')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:41:05.148535 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:41:05.192841 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 121, target: iqn.2023-03.storpool.com:os--volume-3d432c0f-6d42-4549-87fb-1659ec285b6c, portal: 192.168.40.100,3260] Jul 05 03:41:05.192841 np0000004562 cinder-backup[101413]: Logout of [sid: 121, target: iqn.2023-03.storpool.com:os--volume-3d432c0f-6d42-4549-87fb-1659ec285b6c, portal: 192.168.40.100,3260] successful. Jul 05 03:41:05.192841 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:41:05.217035 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:41:05.217257 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.194s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:41:05.217372 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] <== disconnect_volume: return (194ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:41:06.238923 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-36d960e1-4417-4755-a7e2-bb89b86df165 tempest-VolumesBackupsTest-551128076 None] Create backup finished. backup: 200bfbae-9329-436b-8f6f-8267b7226aff. Jul 05 03:41:08.335580 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Restore backup started, backup: 200bfbae-9329-436b-8f6f-8267b7226aff volume: 92d71709-aec8-48f8-a31c-2ea0b87961c1. Jul 05 03:41:08.350602 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_9ebf67ca50e54c89bb8084c855cb1e32 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:41:08.350886 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:41:08.351323 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:41:08.361072 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:41:08.378166 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:41:08.389906 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:41:08.390388 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:41:08.397374 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:41:08.399083 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe7d:7daa', 'fe80::c813:fdff:fe18:febe', 'fe80::f816:3eff:fe32:6af1', 'fe80::c8e9:89ff:febf:bf90', 'fe80::f816:3eff:fe03:899f', 'fe80::e075:aff:fed9:9a2e', 'fe80::f816:3eff:feba:8469', 'fe80::f816:3eff:fe69:1b49', 'fe80::f816:3eff:fe2d:3847', 'fe80::c12:3eff:fe92:c55e', 'fe80::14f3:d8ff:fe98:6988'] Jul 05 03:41:08.399268 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:41:08.399458 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:41:08.399765 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] <== get_connector_properties: return (47ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:41:09.406386 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:41:09.406883 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-92d71709-aec8-48f8-a31c-2ea0b87961c1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '92d71709-aec8-48f8-a31c-2ea0b87961c1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:41:09.407103 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:41:09.961137 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.554s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:41:09.961379 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-92d71709-aec8-48f8-a31c-2ea0b87961c1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '92d71709-aec8-48f8-a31c-2ea0b87961c1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:41:09.972396 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-92d71709-aec8-48f8-a31c-2ea0b87961c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:41:09.972770 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-92d71709-aec8-48f8-a31c-2ea0b87961c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:41:09.972963 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:41:09.985447 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:41:09.985447 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:41:09.996088 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-92d71709-aec8-48f8-a31c-2ea0b87961c1] added Jul 05 03:41:09.996088 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:41:09.996088 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:41:09.996088 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:41:09.996088 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:41:09.996088 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:41:09.996088 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:41:09.996346 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:41:09.996866 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0236(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:41:09.997029 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:41:10.997822 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-92d71709-aec8-48f8-a31c-2ea0b87961c1 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:41:11.010284 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:41:11.021655 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:41:11.041325 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:41:11.041325 np0000004562 cinder-backup[101413]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:41:11.041325 np0000004562 cinder-backup[101413]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:41:11.041325 np0000004562 cinder-backup[101413]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:41:11.041325 np0000004562 cinder-backup[101413]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:41:11.041325 np0000004562 cinder-backup[101413]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:41:11.041325 np0000004562 cinder-backup[101413]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:11.041325 np0000004562 cinder-backup[101413]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:11.041325 np0000004562 cinder-backup[101413]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:41:11.041325 np0000004562 cinder-backup[101413]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:41:11.041325 np0000004562 cinder-backup[101413]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:11.041325 np0000004562 cinder-backup[101413]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:11.041325 np0000004562 cinder-backup[101413]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d9be8ec-cfb1-4696-811d-61290737f3d4 (non-flash) Jul 05 03:41:11.041325 np0000004562 cinder-backup[101413]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d9be8ec-cfb1-4696-811d-61290737f3d4 (non-flash) Jul 05 03:41:11.041325 np0000004562 cinder-backup[101413]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:11.041325 np0000004562 cinder-backup[101413]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:11.041325 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:41:11.041871 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:41:11.041871 np0000004562 cinder-backup[101413]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:41:11.041871 np0000004562 cinder-backup[101413]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:41:11.041871 np0000004562 cinder-backup[101413]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:41:11.041871 np0000004562 cinder-backup[101413]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:41:11.041871 np0000004562 cinder-backup[101413]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:41:11.041871 np0000004562 cinder-backup[101413]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:11.041871 np0000004562 cinder-backup[101413]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:11.041871 np0000004562 cinder-backup[101413]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:41:11.041871 np0000004562 cinder-backup[101413]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:41:11.041871 np0000004562 cinder-backup[101413]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:11.041871 np0000004562 cinder-backup[101413]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:11.041871 np0000004562 cinder-backup[101413]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d9be8ec-cfb1-4696-811d-61290737f3d4 (non-flash) Jul 05 03:41:11.041871 np0000004562 cinder-backup[101413]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d9be8ec-cfb1-4696-811d-61290737f3d4 (non-flash) Jul 05 03:41:11.041871 np0000004562 cinder-backup[101413]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:11.041871 np0000004562 cinder-backup[101413]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:11.041871 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:41:11.105270 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-92d71709-aec8-48f8-a31c-2ea0b87961c1, portal: 192.168.40.100,3260] Jul 05 03:41:11.105270 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-92d71709-aec8-48f8-a31c-2ea0b87961c1, portal: 192.168.40.100,3260] successful. Jul 05 03:41:11.105270 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:41:11.117549 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:41:11.137679 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:41:11.137679 np0000004562 cinder-backup[101413]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:41:11.137679 np0000004562 cinder-backup[101413]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:41:11.137679 np0000004562 cinder-backup[101413]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:41:11.137679 np0000004562 cinder-backup[101413]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:41:11.137679 np0000004562 cinder-backup[101413]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:41:11.137679 np0000004562 cinder-backup[101413]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:11.137679 np0000004562 cinder-backup[101413]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:11.137679 np0000004562 cinder-backup[101413]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:41:11.137679 np0000004562 cinder-backup[101413]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:41:11.137679 np0000004562 cinder-backup[101413]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:11.137679 np0000004562 cinder-backup[101413]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:11.137679 np0000004562 cinder-backup[101413]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d9be8ec-cfb1-4696-811d-61290737f3d4 (non-flash) Jul 05 03:41:11.137679 np0000004562 cinder-backup[101413]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d9be8ec-cfb1-4696-811d-61290737f3d4 (non-flash) Jul 05 03:41:11.137679 np0000004562 cinder-backup[101413]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d71709-aec8-48f8-a31c-2ea0b87961c1 (non-flash) Jul 05 03:41:11.137679 np0000004562 cinder-backup[101413]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:11.137679 np0000004562 cinder-backup[101413]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:11.137679 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:41:11.138042 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:41:11.138042 np0000004562 cinder-backup[101413]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:41:11.138042 np0000004562 cinder-backup[101413]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:41:11.138042 np0000004562 cinder-backup[101413]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:41:11.138042 np0000004562 cinder-backup[101413]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:41:11.138042 np0000004562 cinder-backup[101413]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:41:11.138042 np0000004562 cinder-backup[101413]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:11.138042 np0000004562 cinder-backup[101413]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:11.138042 np0000004562 cinder-backup[101413]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:41:11.138042 np0000004562 cinder-backup[101413]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:41:11.138042 np0000004562 cinder-backup[101413]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:11.138042 np0000004562 cinder-backup[101413]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:11.138042 np0000004562 cinder-backup[101413]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d9be8ec-cfb1-4696-811d-61290737f3d4 (non-flash) Jul 05 03:41:11.138042 np0000004562 cinder-backup[101413]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d9be8ec-cfb1-4696-811d-61290737f3d4 (non-flash) Jul 05 03:41:11.138042 np0000004562 cinder-backup[101413]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d71709-aec8-48f8-a31c-2ea0b87961c1 (non-flash) Jul 05 03:41:11.138042 np0000004562 cinder-backup[101413]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:11.138042 np0000004562 cinder-backup[101413]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:11.138042 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:41:11.138309 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-92d71709-aec8-48f8-a31c-2ea0b87961c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.166s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:41:11.138479 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:41:11.140281 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] HCTL ('14', '-', '-', 0) found on session 126 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:41:11.140417 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Scanning host 14 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:41:11.153114 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Searching for a device in session 126 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:41:11.153114 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-92d71709-aec8-48f8-a31c-2ea0b87961c1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '92d71709-aec8-48f8-a31c-2ea0b87961c1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:41:11.769946 np0000004562 cinder-backup[101413]: DEBUG oslo_service.periodic_task [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:41:11.770205 np0000004562 cinder-backup[101413]: DEBUG cinder.manager [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Notifying Schedulers of capabilities ... {{(pid=101413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:41:12.159479 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.196s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:41:12.159479 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] <== connect_volume: return (2750ms) {'type': 'block', 'scsi_wwn': '33000000055cdbc53', 'path': '/dev/sdi'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:41:12.159479 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdi {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:41:12.177897 np0000004562 sudo[136966]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdi Jul 05 03:41:12.178516 np0000004562 sudo[136966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:41:12.461380 np0000004562 sudo[136966]: pam_unix(sudo:session): session closed for user root Jul 05 03:41:12.463403 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdi" returned: 0 in 0.305s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:41:12.463888 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] starting restore of backup volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff container: tempest-volumesbackupstest-backup-container-854621895, to new volume 92d71709-aec8-48f8-a31c-2ea0b87961c1, backup: 200bfbae-9329-436b-8f6f-8267b7226aff. {{(pid=101413) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jul 05 03:41:12.464086 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] _read_metadata started, container name: tempest-volumesbackupstest-backup-container-854621895, metadata filename: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff_metadata. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] _read_metadata finished. Metadata: { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "backup_description": null, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "backup_id": "200bfbae-9329-436b-8f6f-8267b7226aff", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "backup_name": "tempest-VolumesBackupsTest-Backup-1308659195", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "created_at": "2026-07-05 03:40:49+00:00", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "objects": [ Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00001": { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "md5": "82571f7121cb9475563edde615e4e4df", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "offset": 0 Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00002": { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "offset": 52428800 Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00003": { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "md5": "a35891500449df17e893f84bd88472fb", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "offset": 104857600 Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00004": { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "offset": 157286400 Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00005": { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "offset": 209715200 Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00006": { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "offset": 262144000 Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00007": { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "offset": 314572800 Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00008": { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "offset": 367001600 Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00009": { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "offset": 419430400 Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00010": { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "offset": 471859200 Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00011": { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "offset": 524288000 Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00012": { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "offset": 576716800 Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00013": { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "offset": 629145600 Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00014": { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "offset": 681574400 Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00015": { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "offset": 734003200 Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00016": { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "offset": 786432000 Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00017": { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "offset": 838860800 Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00018": { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "offset": 891289600 Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00019": { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "offset": 943718400 Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00020": { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "offset": 996147200 Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00021": { Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "length": 25165824, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "offset": 1048576000 Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: ], Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "parent_id": null, Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "version": "1.0.0", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "volume_id": "3d432c0f-6d42-4549-87fb-1659ec285b6c", Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"3d432c0f-6d42-4549-87fb-1659ec285b6c\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"e89d8ef0122f41c999bbb4d9fd9d8712\", \"project_id\": \"9ebf67ca50e54c89bb8084c855cb1e32\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004562@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T03:40:48.000000\", \"launched_at\": \"2026-07-05T03:40:48.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-418611836\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": true, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"ac464b70-f08d-447b-aa26-2823b4948fc2\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T03:40:47.000000\", \"updated_at\": \"2026-07-05T03:40:49.000000\"}, \"volume-glance-metadata\": {\"hw_rng_model\": \"virtio\", \"os_glance_failed_import\": \"\", \"os_glance_importing_to_stores\": \"\", \"owner_specified.openstack.md5\": \"\", \"owner_specified.openstack.object\": \"images/cirros-0.6.3-x86_64-disk\", \"owner_specified.openstack.sha256\": \"\", \"image_id\": \"0c8fa207-3de5-4489-a2c5-f4cc8559edb8\", \"image_name\": \"cirros-0.6.3-x86_64-disk\", \"checksum\": \"87617e24a5e30cb3b87fda8c0764838f\", \"container_format\": \"bare\", \"disk_format\": \"qcow2\", \"min_disk\": \"0\", \"min_ram\": \"0\", \"size\": \"21692416\"}}" Jul 05 03:41:12.489045 np0000004562 cinder-backup[101413]: }. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 03:41:12.492490 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Restoring backup version 1.0.0 {{(pid=101413) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jul 05 03:41:12.492490 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] _read_metadata started, container name: tempest-volumesbackupstest-backup-container-854621895, metadata filename: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff_metadata. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] _read_metadata finished. Metadata: { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "backup_description": null, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "backup_id": "200bfbae-9329-436b-8f6f-8267b7226aff", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "backup_name": "tempest-VolumesBackupsTest-Backup-1308659195", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "created_at": "2026-07-05 03:40:49+00:00", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "objects": [ Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00001": { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "md5": "82571f7121cb9475563edde615e4e4df", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "offset": 0 Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00002": { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "offset": 52428800 Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00003": { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "md5": "a35891500449df17e893f84bd88472fb", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "offset": 104857600 Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00004": { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "offset": 157286400 Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00005": { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "offset": 209715200 Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00006": { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "offset": 262144000 Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00007": { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "offset": 314572800 Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00008": { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "offset": 367001600 Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00009": { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "offset": 419430400 Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00010": { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "offset": 471859200 Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00011": { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "offset": 524288000 Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00012": { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "offset": 576716800 Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00013": { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "offset": 629145600 Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00014": { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "offset": 681574400 Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00015": { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "offset": 734003200 Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00016": { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "offset": 786432000 Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00017": { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "offset": 838860800 Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00018": { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "offset": 891289600 Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00019": { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "offset": 943718400 Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00020": { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "offset": 996147200 Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00021": { Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "length": 25165824, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "offset": 1048576000 Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: } Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: ], Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "parent_id": null, Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "version": "1.0.0", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "volume_id": "3d432c0f-6d42-4549-87fb-1659ec285b6c", Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"3d432c0f-6d42-4549-87fb-1659ec285b6c\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"e89d8ef0122f41c999bbb4d9fd9d8712\", \"project_id\": \"9ebf67ca50e54c89bb8084c855cb1e32\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004562@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T03:40:48.000000\", \"launched_at\": \"2026-07-05T03:40:48.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-418611836\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": true, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"ac464b70-f08d-447b-aa26-2823b4948fc2\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T03:40:47.000000\", \"updated_at\": \"2026-07-05T03:40:49.000000\"}, \"volume-glance-metadata\": {\"hw_rng_model\": \"virtio\", \"os_glance_failed_import\": \"\", \"os_glance_importing_to_stores\": \"\", \"owner_specified.openstack.md5\": \"\", \"owner_specified.openstack.object\": \"images/cirros-0.6.3-x86_64-disk\", \"owner_specified.openstack.sha256\": \"\", \"image_id\": \"0c8fa207-3de5-4489-a2c5-f4cc8559edb8\", \"image_name\": \"cirros-0.6.3-x86_64-disk\", \"checksum\": \"87617e24a5e30cb3b87fda8c0764838f\", \"container_format\": \"bare\", \"disk_format\": \"qcow2\", \"min_disk\": \"0\", \"min_ram\": \"0\", \"size\": \"21692416\"}}" Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: }. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] v1 volume backup restore of 200bfbae-9329-436b-8f6f-8267b7226aff started. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 05 03:41:12.520229 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] metadata_object_names = ['volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00001', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00002', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00003', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00004', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00005', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00006', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00007', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00008', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00009', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00010', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00011', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00012', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00013', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00014', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00015', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00016', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00017', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00018', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00019', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00020', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00021']. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 05 03:41:12.572967 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] generated object list: ['volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00001', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00002', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00003', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00004', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00005', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00006', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00007', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00008', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00009', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00010', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00011', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00012', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00013', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00014', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00015', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00016', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00017', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00018', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00019', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00020', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00021', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff_metadata', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:41:12.610037 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:41:12.614135 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: 200bfbae-9329-436b-8f6f-8267b7226aff, container: tempest-volumesbackupstest-backup-container-854621895, object name: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00001, volume: 92d71709-aec8-48f8-a31c-2ea0b87961c1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:12.727058 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:13.233841 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: 200bfbae-9329-436b-8f6f-8267b7226aff, container: tempest-volumesbackupstest-backup-container-854621895, object name: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00002, volume: 92d71709-aec8-48f8-a31c-2ea0b87961c1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:13.255847 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:13.610308 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: 200bfbae-9329-436b-8f6f-8267b7226aff, container: tempest-volumesbackupstest-backup-container-854621895, object name: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00003, volume: 92d71709-aec8-48f8-a31c-2ea0b87961c1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:13.637350 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:14.008363 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: 200bfbae-9329-436b-8f6f-8267b7226aff, container: tempest-volumesbackupstest-backup-container-854621895, object name: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00004, volume: 92d71709-aec8-48f8-a31c-2ea0b87961c1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:14.027476 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:14.399703 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: 200bfbae-9329-436b-8f6f-8267b7226aff, container: tempest-volumesbackupstest-backup-container-854621895, object name: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00005, volume: 92d71709-aec8-48f8-a31c-2ea0b87961c1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:14.414736 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:14.774829 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: 200bfbae-9329-436b-8f6f-8267b7226aff, container: tempest-volumesbackupstest-backup-container-854621895, object name: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00006, volume: 92d71709-aec8-48f8-a31c-2ea0b87961c1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:14.795334 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:15.136734 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: 200bfbae-9329-436b-8f6f-8267b7226aff, container: tempest-volumesbackupstest-backup-container-854621895, object name: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00007, volume: 92d71709-aec8-48f8-a31c-2ea0b87961c1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:15.151790 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:15.495182 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: 200bfbae-9329-436b-8f6f-8267b7226aff, container: tempest-volumesbackupstest-backup-container-854621895, object name: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00008, volume: 92d71709-aec8-48f8-a31c-2ea0b87961c1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:15.510126 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:15.851279 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: 200bfbae-9329-436b-8f6f-8267b7226aff, container: tempest-volumesbackupstest-backup-container-854621895, object name: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00009, volume: 92d71709-aec8-48f8-a31c-2ea0b87961c1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:15.873255 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:16.217433 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: 200bfbae-9329-436b-8f6f-8267b7226aff, container: tempest-volumesbackupstest-backup-container-854621895, object name: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00010, volume: 92d71709-aec8-48f8-a31c-2ea0b87961c1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:16.230607 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:16.575550 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: 200bfbae-9329-436b-8f6f-8267b7226aff, container: tempest-volumesbackupstest-backup-container-854621895, object name: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00011, volume: 92d71709-aec8-48f8-a31c-2ea0b87961c1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:16.589081 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:16.922934 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: 200bfbae-9329-436b-8f6f-8267b7226aff, container: tempest-volumesbackupstest-backup-container-854621895, object name: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00012, volume: 92d71709-aec8-48f8-a31c-2ea0b87961c1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:16.938033 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:17.274186 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: 200bfbae-9329-436b-8f6f-8267b7226aff, container: tempest-volumesbackupstest-backup-container-854621895, object name: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00013, volume: 92d71709-aec8-48f8-a31c-2ea0b87961c1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:17.289160 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:17.631548 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: 200bfbae-9329-436b-8f6f-8267b7226aff, container: tempest-volumesbackupstest-backup-container-854621895, object name: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00014, volume: 92d71709-aec8-48f8-a31c-2ea0b87961c1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:17.649591 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:18.050668 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: 200bfbae-9329-436b-8f6f-8267b7226aff, container: tempest-volumesbackupstest-backup-container-854621895, object name: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00015, volume: 92d71709-aec8-48f8-a31c-2ea0b87961c1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:18.067304 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:18.447530 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: 200bfbae-9329-436b-8f6f-8267b7226aff, container: tempest-volumesbackupstest-backup-container-854621895, object name: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00016, volume: 92d71709-aec8-48f8-a31c-2ea0b87961c1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:18.464850 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:18.824369 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: 200bfbae-9329-436b-8f6f-8267b7226aff, container: tempest-volumesbackupstest-backup-container-854621895, object name: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00017, volume: 92d71709-aec8-48f8-a31c-2ea0b87961c1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:18.844734 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:19.207737 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: 200bfbae-9329-436b-8f6f-8267b7226aff, container: tempest-volumesbackupstest-backup-container-854621895, object name: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00018, volume: 92d71709-aec8-48f8-a31c-2ea0b87961c1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:19.230328 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:19.572922 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: 200bfbae-9329-436b-8f6f-8267b7226aff, container: tempest-volumesbackupstest-backup-container-854621895, object name: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00019, volume: 92d71709-aec8-48f8-a31c-2ea0b87961c1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:19.589207 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:19.921246 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: 200bfbae-9329-436b-8f6f-8267b7226aff, container: tempest-volumesbackupstest-backup-container-854621895, object name: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00020, volume: 92d71709-aec8-48f8-a31c-2ea0b87961c1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:19.964990 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:20.299458 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: 200bfbae-9329-436b-8f6f-8267b7226aff, container: tempest-volumesbackupstest-backup-container-854621895, object name: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00021, volume: 92d71709-aec8-48f8-a31c-2ea0b87961c1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:20.320588 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:20.506769 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] v1 volume backup restore of 200bfbae-9329-436b-8f6f-8267b7226aff finished. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 05 03:41:20.507800 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Restoring volume base metadata {{(pid=101413) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 05 03:41:20.530567 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] No metadata of type 'volume-metadata' to restore {{(pid=101413) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 05 03:41:20.530729 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Restoring volume glance metadata {{(pid=101413) _restore_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:258}} Jul 05 03:41:20.654992 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] restore 200bfbae-9329-436b-8f6f-8267b7226aff to 92d71709-aec8-48f8-a31c-2ea0b87961c1 finished. {{(pid=101413) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jul 05 03:41:20.664696 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdi {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:41:20.683938 np0000004562 sudo[137232]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdi Jul 05 03:41:20.684568 np0000004562 sudo[137232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:41:21.034408 np0000004562 sudo[137232]: pam_unix(sudo:session): session closed for user root Jul 05 03:41:21.037941 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdi" returned: 0 in 0.373s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:41:21.038660 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-92d71709-aec8-48f8-a31c-2ea0b87961c1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '92d71709-aec8-48f8-a31c-2ea0b87961c1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '33000000055cdbc53', 'path': '/dev/sdi'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:41:21.038943 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:41:21.039550 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:41:21.040079 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-92d71709-aec8-48f8-a31c-2ea0b87961c1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '92d71709-aec8-48f8-a31c-2ea0b87961c1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-c1a1a237-ff2d-4bb0-807f-1b190e07d399 Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-1d9be8ec-cfb1-4696-811d-61290737f3d4 Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-92d71709-aec8-48f8-a31c-2ea0b87961c1 Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:41:21.055599 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:41:21.057028 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:41:21.057028 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:41:21.057028 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:41:21.057028 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92d71709-aec8-48f8-a31c-2ea0b87961c1', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:41:21.097964 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:41:21.097964 np0000004562 cinder-backup[101413]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:41:21.097964 np0000004562 cinder-backup[101413]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:41:21.097964 np0000004562 cinder-backup[101413]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:41:21.097964 np0000004562 cinder-backup[101413]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:41:21.097964 np0000004562 cinder-backup[101413]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:41:21.097964 np0000004562 cinder-backup[101413]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:21.097964 np0000004562 cinder-backup[101413]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:21.097964 np0000004562 cinder-backup[101413]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:41:21.097964 np0000004562 cinder-backup[101413]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:41:21.097964 np0000004562 cinder-backup[101413]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:21.097964 np0000004562 cinder-backup[101413]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:21.097964 np0000004562 cinder-backup[101413]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d9be8ec-cfb1-4696-811d-61290737f3d4 (non-flash) Jul 05 03:41:21.097964 np0000004562 cinder-backup[101413]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d9be8ec-cfb1-4696-811d-61290737f3d4 (non-flash) Jul 05 03:41:21.097964 np0000004562 cinder-backup[101413]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d71709-aec8-48f8-a31c-2ea0b87961c1 (non-flash) Jul 05 03:41:21.097964 np0000004562 cinder-backup[101413]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1a1a237-ff2d-4bb0-807f-1b190e07d399 (non-flash) Jul 05 03:41:21.097964 np0000004562 cinder-backup[101413]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1a1a237-ff2d-4bb0-807f-1b190e07d399 (non-flash) Jul 05 03:41:21.097964 np0000004562 cinder-backup[101413]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:21.097964 np0000004562 cinder-backup[101413]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:21.097964 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:41:21.098619 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:41:21.098619 np0000004562 cinder-backup[101413]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:41:21.098619 np0000004562 cinder-backup[101413]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:41:21.098619 np0000004562 cinder-backup[101413]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:41:21.098619 np0000004562 cinder-backup[101413]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:41:21.098619 np0000004562 cinder-backup[101413]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2 (non-flash) Jul 05 03:41:21.098619 np0000004562 cinder-backup[101413]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:21.098619 np0000004562 cinder-backup[101413]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:21.098619 np0000004562 cinder-backup[101413]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:41:21.098619 np0000004562 cinder-backup[101413]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:41:21.098619 np0000004562 cinder-backup[101413]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:21.098619 np0000004562 cinder-backup[101413]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:21.098619 np0000004562 cinder-backup[101413]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d9be8ec-cfb1-4696-811d-61290737f3d4 (non-flash) Jul 05 03:41:21.098619 np0000004562 cinder-backup[101413]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d9be8ec-cfb1-4696-811d-61290737f3d4 (non-flash) Jul 05 03:41:21.098619 np0000004562 cinder-backup[101413]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d71709-aec8-48f8-a31c-2ea0b87961c1 (non-flash) Jul 05 03:41:21.098619 np0000004562 cinder-backup[101413]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1a1a237-ff2d-4bb0-807f-1b190e07d399 (non-flash) Jul 05 03:41:21.098619 np0000004562 cinder-backup[101413]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1a1a237-ff2d-4bb0-807f-1b190e07d399 (non-flash) Jul 05 03:41:21.098619 np0000004562 cinder-backup[101413]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:21.098619 np0000004562 cinder-backup[101413]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:21.098619 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:41:21.098619 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74', '105'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4', '106'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2', '108'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-302c8184-fc8d-4627-bd85-873481f6c2d2', '109'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6', '115'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2', '117'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390', '122'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390', '123'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d9be8ec-cfb1-4696-811d-61290737f3d4', '124'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d9be8ec-cfb1-4696-811d-61290737f3d4', '125'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92d71709-aec8-48f8-a31c-2ea0b87961c1', '126'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1a1a237-ff2d-4bb0-807f-1b190e07d399', '127'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1a1a237-ff2d-4bb0-807f-1b190e07d399', '128'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce', '98'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce', '99')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:41:21.099275 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-92d71709-aec8-48f8-a31c-2ea0b87961c1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92d71709-aec8-48f8-a31c-2ea0b87961c1', '126')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:41:21.100622 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Resulting device map defaultdict(. at 0x72a48ebffa60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92d71709-aec8-48f8-a31c-2ea0b87961c1'): ({'sdi'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:41:21.101430 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Removing single pathed devices sdi {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:41:21.116504 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Flushing IO for device /dev/sdi {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:41:21.126793 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:41:21.181214 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Checking to see if SCSI volumes sdi have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:41:21.181414 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] SCSI volumes sdi have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:41:21.183185 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Checking to see if device paths {'sdi'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:41:21.195864 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Device paths {'sdi'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:41:21.196164 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92d71709-aec8-48f8-a31c-2ea0b87961c1')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:41:21.209806 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:41:21.257549 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 126, target: iqn.2023-03.storpool.com:os--volume-92d71709-aec8-48f8-a31c-2ea0b87961c1, portal: 192.168.40.100,3260] Jul 05 03:41:21.257549 np0000004562 cinder-backup[101413]: Logout of [sid: 126, target: iqn.2023-03.storpool.com:os--volume-92d71709-aec8-48f8-a31c-2ea0b87961c1, portal: 192.168.40.100,3260] successful. Jul 05 03:41:21.257549 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:41:21.283599 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:41:21.283846 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.244s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:41:21.284023 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] <== disconnect_volume: return (245ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:41:22.297786 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.manager [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Encryption key ID for volume 92d71709-aec8-48f8-a31c-2ea0b87961c1 already matches encryption key ID in backup 200bfbae-9329-436b-8f6f-8267b7226aff. {{(pid=101413) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jul 05 03:41:22.320167 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-d879b367-0492-46d7-876d-083122cf21f6 tempest-VolumesBackupsTest-551128076 None] Finished restoring backup 200bfbae-9329-436b-8f6f-8267b7226aff to volume 92d71709-aec8-48f8-a31c-2ea0b87961c1. Jul 05 03:41:23.939627 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-af095d36-e726-404e-ab0a-0155615e3eab tempest-VolumesBackupsTest-551128076 None] Delete backup started, backup: 200bfbae-9329-436b-8f6f-8267b7226aff. Jul 05 03:41:23.949660 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-af095d36-e726-404e-ab0a-0155615e3eab tempest-VolumesBackupsTest-551128076 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_9ebf67ca50e54c89bb8084c855cb1e32 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:41:23.950148 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-af095d36-e726-404e-ab0a-0155615e3eab tempest-VolumesBackupsTest-551128076 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:41:23.950361 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-af095d36-e726-404e-ab0a-0155615e3eab tempest-VolumesBackupsTest-551128076 None] delete started, backup: 200bfbae-9329-436b-8f6f-8267b7226aff, container: tempest-volumesbackupstest-backup-container-854621895, prefix: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:41:23.986218 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-af095d36-e726-404e-ab0a-0155615e3eab tempest-VolumesBackupsTest-551128076 None] generated object list: ['volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00001', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00002', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00003', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00004', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00005', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00006', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00007', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00008', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00009', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00010', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00011', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00012', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00013', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00014', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00015', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00016', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00017', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00018', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00019', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00020', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00021', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff_metadata', 'volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:41:24.004311 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-af095d36-e726-404e-ab0a-0155615e3eab tempest-VolumesBackupsTest-551128076 None] deleted object: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00001 in container: tempest-volumesbackupstest-backup-container-854621895. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:41:24.021616 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-af095d36-e726-404e-ab0a-0155615e3eab tempest-VolumesBackupsTest-551128076 None] deleted object: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00002 in container: tempest-volumesbackupstest-backup-container-854621895. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:41:24.040392 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-af095d36-e726-404e-ab0a-0155615e3eab tempest-VolumesBackupsTest-551128076 None] deleted object: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00003 in container: tempest-volumesbackupstest-backup-container-854621895. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:41:24.062048 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-af095d36-e726-404e-ab0a-0155615e3eab tempest-VolumesBackupsTest-551128076 None] deleted object: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00004 in container: tempest-volumesbackupstest-backup-container-854621895. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:41:24.081690 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-af095d36-e726-404e-ab0a-0155615e3eab tempest-VolumesBackupsTest-551128076 None] deleted object: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00005 in container: tempest-volumesbackupstest-backup-container-854621895. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:41:24.099948 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-af095d36-e726-404e-ab0a-0155615e3eab tempest-VolumesBackupsTest-551128076 None] deleted object: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00006 in container: tempest-volumesbackupstest-backup-container-854621895. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:41:24.121597 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-af095d36-e726-404e-ab0a-0155615e3eab tempest-VolumesBackupsTest-551128076 None] deleted object: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00007 in container: tempest-volumesbackupstest-backup-container-854621895. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:41:24.142140 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-af095d36-e726-404e-ab0a-0155615e3eab tempest-VolumesBackupsTest-551128076 None] deleted object: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00008 in container: tempest-volumesbackupstest-backup-container-854621895. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:41:24.163130 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-af095d36-e726-404e-ab0a-0155615e3eab tempest-VolumesBackupsTest-551128076 None] deleted object: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00009 in container: tempest-volumesbackupstest-backup-container-854621895. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:41:24.183078 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-af095d36-e726-404e-ab0a-0155615e3eab tempest-VolumesBackupsTest-551128076 None] deleted object: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00010 in container: tempest-volumesbackupstest-backup-container-854621895. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:41:24.205855 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-af095d36-e726-404e-ab0a-0155615e3eab tempest-VolumesBackupsTest-551128076 None] deleted object: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00011 in container: tempest-volumesbackupstest-backup-container-854621895. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:41:24.228567 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-af095d36-e726-404e-ab0a-0155615e3eab tempest-VolumesBackupsTest-551128076 None] deleted object: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00012 in container: tempest-volumesbackupstest-backup-container-854621895. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:41:24.247307 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-af095d36-e726-404e-ab0a-0155615e3eab tempest-VolumesBackupsTest-551128076 None] deleted object: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00013 in container: tempest-volumesbackupstest-backup-container-854621895. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:41:24.268852 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-af095d36-e726-404e-ab0a-0155615e3eab tempest-VolumesBackupsTest-551128076 None] deleted object: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00014 in container: tempest-volumesbackupstest-backup-container-854621895. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:41:24.289243 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-af095d36-e726-404e-ab0a-0155615e3eab tempest-VolumesBackupsTest-551128076 None] deleted object: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00015 in container: tempest-volumesbackupstest-backup-container-854621895. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:41:24.310816 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-af095d36-e726-404e-ab0a-0155615e3eab tempest-VolumesBackupsTest-551128076 None] deleted object: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00016 in container: tempest-volumesbackupstest-backup-container-854621895. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:41:24.335583 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-af095d36-e726-404e-ab0a-0155615e3eab tempest-VolumesBackupsTest-551128076 None] deleted object: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00017 in container: tempest-volumesbackupstest-backup-container-854621895. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:41:24.356811 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-af095d36-e726-404e-ab0a-0155615e3eab tempest-VolumesBackupsTest-551128076 None] deleted object: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00018 in container: tempest-volumesbackupstest-backup-container-854621895. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:41:24.376055 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-af095d36-e726-404e-ab0a-0155615e3eab tempest-VolumesBackupsTest-551128076 None] deleted object: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00019 in container: tempest-volumesbackupstest-backup-container-854621895. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:41:24.398180 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-af095d36-e726-404e-ab0a-0155615e3eab tempest-VolumesBackupsTest-551128076 None] deleted object: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00020 in container: tempest-volumesbackupstest-backup-container-854621895. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:41:24.418204 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-af095d36-e726-404e-ab0a-0155615e3eab tempest-VolumesBackupsTest-551128076 None] deleted object: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff-00021 in container: tempest-volumesbackupstest-backup-container-854621895. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:41:24.435599 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-af095d36-e726-404e-ab0a-0155615e3eab tempest-VolumesBackupsTest-551128076 None] deleted object: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff_metadata in container: tempest-volumesbackupstest-backup-container-854621895. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:41:24.455510 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-af095d36-e726-404e-ab0a-0155615e3eab tempest-VolumesBackupsTest-551128076 None] deleted object: volume_3d432c0f-6d42-4549-87fb-1659ec285b6c/20260705034051/az_nova_backup_200bfbae-9329-436b-8f6f-8267b7226aff_sha256file in container: tempest-volumesbackupstest-backup-container-854621895. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:41:24.455695 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-af095d36-e726-404e-ab0a-0155615e3eab tempest-VolumesBackupsTest-551128076 None] delete 200bfbae-9329-436b-8f6f-8267b7226aff finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:41:24.488124 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-af095d36-e726-404e-ab0a-0155615e3eab tempest-VolumesBackupsTest-551128076 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:41:24.500595 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-af095d36-e726-404e-ab0a-0155615e3eab tempest-VolumesBackupsTest-551128076 None] Created reservations ['813d1c2b-b876-4bc1-959a-0a44ac164065', '8394605c-0070-4bd6-af82-5ab68f551802'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:41:24.516821 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-af095d36-e726-404e-ab0a-0155615e3eab tempest-VolumesBackupsTest-551128076 None] Delete backup finished, backup 200bfbae-9329-436b-8f6f-8267b7226aff deleted. Jul 05 03:41:27.635577 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Create backup started, backup: bfd97c4c-4d7c-482e-8b78-b55dba635d6b volume: 1106b103-fed3-4d1b-afd3-ee05e186db26. Jul 05 03:41:27.644724 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-425644664',created_at=2026-07-05T03:41:27Z,data_timestamp=2026-07-05T03:41:27Z,deleted=False,deleted_at=None,display_description='tempest-backup-description-2103089490',display_name='tempest-VolumesBackupsTest-Backup-217274326',encryption_key_id=None,fail_reason=None,host='np0000004562',id=bfd97c4c-4d7c-482e-8b78-b55dba635d6b,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='9ebf67ca50e54c89bb8084c855cb1e32',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='e89d8ef0122f41c999bbb4d9fd9d8712',volume_id=1106b103-fed3-4d1b-afd3-ee05e186db26) Jul 05 03:41:27.684636 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_9ebf67ca50e54c89bb8084c855cb1e32 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:41:27.685046 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:41:27.685480 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:41:27.697374 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:41:27.718450 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:41:27.731377 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:41:27.733504 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:41:27.743747 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:41:27.743747 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe7d:7daa', 'fe80::c813:fdff:fe18:febe', 'fe80::f816:3eff:fe32:6af1', 'fe80::c8e9:89ff:febf:bf90', 'fe80::f816:3eff:fe03:899f', 'fe80::e075:aff:fed9:9a2e', 'fe80::f816:3eff:fe69:1b49', 'fe80::f816:3eff:fe2d:3847', 'fe80::c12:3eff:fe92:c55e', 'fe80::f816:3eff:fe1e:276c', 'fe80::14f3:d8ff:fe98:6988', 'fe80::f816:3eff:fe99:68b5', 'fe80::f816:3eff:fe91:a671', 'fe80::4871:a0ff:feb5:e1d'] Jul 05 03:41:27.744117 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:41:27.744474 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:41:27.744830 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] <== get_connector_properties: return (59ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:41:28.249233 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:41:28.249963 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1106b103-fed3-4d1b-afd3-ee05e186db26', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1106b103-fed3-4d1b-afd3-ee05e186db26', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:41:28.250111 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:41:28.250731 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:41:28.251066 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1106b103-fed3-4d1b-afd3-ee05e186db26', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1106b103-fed3-4d1b-afd3-ee05e186db26', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:41:28.265370 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1106b103-fed3-4d1b-afd3-ee05e186db26" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:41:28.265370 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1106b103-fed3-4d1b-afd3-ee05e186db26" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:41:28.265370 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:41:28.292177 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:41:28.292177 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:41:28.302954 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1106b103-fed3-4d1b-afd3-ee05e186db26] added Jul 05 03:41:28.302954 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:41:28.302954 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:41:28.302954 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:41:28.302954 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:41:28.302954 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:41:28.302954 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:41:28.303273 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:41:28.303583 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0387(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:41:28.303816 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:41:29.305506 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-1106b103-fed3-4d1b-afd3-ee05e186db26 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:41:29.318204 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:41:29.329517 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:41:29.352288 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:41:29.352288 np0000004562 cinder-backup[101413]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:41:29.352288 np0000004562 cinder-backup[101413]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:41:29.352288 np0000004562 cinder-backup[101413]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:41:29.352288 np0000004562 cinder-backup[101413]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:29.352288 np0000004562 cinder-backup[101413]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:29.352288 np0000004562 cinder-backup[101413]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:41:29.352288 np0000004562 cinder-backup[101413]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:41:29.352288 np0000004562 cinder-backup[101413]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:29.352288 np0000004562 cinder-backup[101413]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:29.352288 np0000004562 cinder-backup[101413]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d9be8ec-cfb1-4696-811d-61290737f3d4 (non-flash) Jul 05 03:41:29.352288 np0000004562 cinder-backup[101413]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d9be8ec-cfb1-4696-811d-61290737f3d4 (non-flash) Jul 05 03:41:29.352288 np0000004562 cinder-backup[101413]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1a1a237-ff2d-4bb0-807f-1b190e07d399 (non-flash) Jul 05 03:41:29.352288 np0000004562 cinder-backup[101413]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1a1a237-ff2d-4bb0-807f-1b190e07d399 (non-flash) Jul 05 03:41:29.352288 np0000004562 cinder-backup[101413]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac752b8f-b0bd-47aa-907a-107c66209b94 (non-flash) Jul 05 03:41:29.352288 np0000004562 cinder-backup[101413]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac752b8f-b0bd-47aa-907a-107c66209b94 (non-flash) Jul 05 03:41:29.352288 np0000004562 cinder-backup[101413]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:29.352288 np0000004562 cinder-backup[101413]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:29.352288 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:41:29.352849 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:41:29.352849 np0000004562 cinder-backup[101413]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:41:29.352849 np0000004562 cinder-backup[101413]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:41:29.352849 np0000004562 cinder-backup[101413]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:41:29.352849 np0000004562 cinder-backup[101413]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:29.352849 np0000004562 cinder-backup[101413]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:29.352849 np0000004562 cinder-backup[101413]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:41:29.352849 np0000004562 cinder-backup[101413]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:41:29.352849 np0000004562 cinder-backup[101413]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:29.352849 np0000004562 cinder-backup[101413]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:29.352849 np0000004562 cinder-backup[101413]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d9be8ec-cfb1-4696-811d-61290737f3d4 (non-flash) Jul 05 03:41:29.352849 np0000004562 cinder-backup[101413]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d9be8ec-cfb1-4696-811d-61290737f3d4 (non-flash) Jul 05 03:41:29.352849 np0000004562 cinder-backup[101413]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1a1a237-ff2d-4bb0-807f-1b190e07d399 (non-flash) Jul 05 03:41:29.352849 np0000004562 cinder-backup[101413]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1a1a237-ff2d-4bb0-807f-1b190e07d399 (non-flash) Jul 05 03:41:29.352849 np0000004562 cinder-backup[101413]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac752b8f-b0bd-47aa-907a-107c66209b94 (non-flash) Jul 05 03:41:29.352849 np0000004562 cinder-backup[101413]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac752b8f-b0bd-47aa-907a-107c66209b94 (non-flash) Jul 05 03:41:29.352849 np0000004562 cinder-backup[101413]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:29.352849 np0000004562 cinder-backup[101413]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:29.352849 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:41:29.410180 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1106b103-fed3-4d1b-afd3-ee05e186db26, portal: 192.168.40.100,3260] Jul 05 03:41:29.410180 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1106b103-fed3-4d1b-afd3-ee05e186db26, portal: 192.168.40.100,3260] successful. Jul 05 03:41:29.410180 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:41:29.424731 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:41:29.453532 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:41:29.453532 np0000004562 cinder-backup[101413]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:41:29.453532 np0000004562 cinder-backup[101413]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:41:29.453532 np0000004562 cinder-backup[101413]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:41:29.453532 np0000004562 cinder-backup[101413]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:29.453532 np0000004562 cinder-backup[101413]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:29.453532 np0000004562 cinder-backup[101413]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:41:29.453532 np0000004562 cinder-backup[101413]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:41:29.453532 np0000004562 cinder-backup[101413]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:29.453532 np0000004562 cinder-backup[101413]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:29.453532 np0000004562 cinder-backup[101413]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d9be8ec-cfb1-4696-811d-61290737f3d4 (non-flash) Jul 05 03:41:29.453532 np0000004562 cinder-backup[101413]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d9be8ec-cfb1-4696-811d-61290737f3d4 (non-flash) Jul 05 03:41:29.453532 np0000004562 cinder-backup[101413]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1a1a237-ff2d-4bb0-807f-1b190e07d399 (non-flash) Jul 05 03:41:29.453532 np0000004562 cinder-backup[101413]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1a1a237-ff2d-4bb0-807f-1b190e07d399 (non-flash) Jul 05 03:41:29.453532 np0000004562 cinder-backup[101413]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac752b8f-b0bd-47aa-907a-107c66209b94 (non-flash) Jul 05 03:41:29.453532 np0000004562 cinder-backup[101413]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac752b8f-b0bd-47aa-907a-107c66209b94 (non-flash) Jul 05 03:41:29.453532 np0000004562 cinder-backup[101413]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1106b103-fed3-4d1b-afd3-ee05e186db26 (non-flash) Jul 05 03:41:29.453532 np0000004562 cinder-backup[101413]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:29.453532 np0000004562 cinder-backup[101413]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:29.453532 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:41:29.453942 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:41:29.453942 np0000004562 cinder-backup[101413]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4414032e-afbd-49f9-83de-6328bef53b74 (non-flash) Jul 05 03:41:29.453942 np0000004562 cinder-backup[101413]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:41:29.453942 np0000004562 cinder-backup[101413]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-586d1980-2cfb-4edd-b243-fad68bdd12b4 (non-flash) Jul 05 03:41:29.453942 np0000004562 cinder-backup[101413]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:29.453942 np0000004562 cinder-backup[101413]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:29.453942 np0000004562 cinder-backup[101413]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:41:29.453942 np0000004562 cinder-backup[101413]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:41:29.453942 np0000004562 cinder-backup[101413]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:29.453942 np0000004562 cinder-backup[101413]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:29.453942 np0000004562 cinder-backup[101413]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d9be8ec-cfb1-4696-811d-61290737f3d4 (non-flash) Jul 05 03:41:29.453942 np0000004562 cinder-backup[101413]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d9be8ec-cfb1-4696-811d-61290737f3d4 (non-flash) Jul 05 03:41:29.453942 np0000004562 cinder-backup[101413]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1a1a237-ff2d-4bb0-807f-1b190e07d399 (non-flash) Jul 05 03:41:29.453942 np0000004562 cinder-backup[101413]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1a1a237-ff2d-4bb0-807f-1b190e07d399 (non-flash) Jul 05 03:41:29.453942 np0000004562 cinder-backup[101413]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac752b8f-b0bd-47aa-907a-107c66209b94 (non-flash) Jul 05 03:41:29.453942 np0000004562 cinder-backup[101413]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac752b8f-b0bd-47aa-907a-107c66209b94 (non-flash) Jul 05 03:41:29.453942 np0000004562 cinder-backup[101413]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1106b103-fed3-4d1b-afd3-ee05e186db26 (non-flash) Jul 05 03:41:29.453942 np0000004562 cinder-backup[101413]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:29.453942 np0000004562 cinder-backup[101413]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:29.453942 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:41:29.454238 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1106b103-fed3-4d1b-afd3-ee05e186db26" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.190s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:41:29.454238 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:41:29.457150 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] HCTL ('16', '-', '-', 0) found on session 131 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:41:29.457402 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Scanning host 16 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:41:29.478084 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Searching for a device in session 131 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:41:29.479205 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1106b103-fed3-4d1b-afd3-ee05e186db26', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1106b103-fed3-4d1b-afd3-ee05e186db26', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:41:30.483748 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.233s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:41:30.484190 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] <== connect_volume: return (2234ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799139', 'path': '/dev/sdk'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:41:30.484534 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdk {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:41:30.502588 np0000004562 sudo[137885]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdk Jul 05 03:41:30.503197 np0000004562 sudo[137885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:41:30.844955 np0000004562 sudo[137885]: pam_unix(sudo:session): session closed for user root Jul 05 03:41:30.847222 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdk" returned: 0 in 0.362s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:41:30.892646 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:41:30.899370 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] _create_container started, container: tempest-volumesbackupstest-backup-container-425644664,backup: bfd97c4c-4d7c-482e-8b78-b55dba635d6b. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:41:30.952843 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] generate_object_name_prefix: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:41:30.963342 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] starting backup of volume: 1106b103-fed3-4d1b-afd3-ee05e186db26, volume size: 1073741824, object names prefix volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:41:31.185352 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:41:31.453929 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:41:31.454347 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:41:31.567740 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:41:31.568167 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:41:31.787628 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:41:32.032553 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:41:32.032744 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:41:32.154389 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:41:32.155914 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:41:32.407015 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:41:32.674190 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:41:32.674733 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:41:32.791304 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:41:32.791530 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:41:32.992121 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:41:33.242186 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:41:33.242329 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:41:33.342977 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:41:33.343272 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:41:33.576979 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:41:33.842061 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:41:33.842620 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:41:33.966660 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:41:33.966834 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:41:34.169797 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:41:34.425962 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:41:34.426154 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:41:34.529603 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:41:34.529789 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:41:34.725647 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:41:34.971148 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:41:34.971805 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:41:35.091927 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:41:35.092099 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:41:35.316296 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:41:35.563990 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:41:35.564270 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:41:35.690412 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:41:35.690568 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:41:35.913115 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:41:36.156418 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:41:36.156964 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:41:36.256481 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:41:36.256624 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:41:36.475508 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:41:36.754792 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:41:36.755015 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:41:36.862606 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:41:36.862810 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:41:37.147022 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:41:37.399245 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:41:37.399675 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:41:37.505827 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:41:37.506014 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:41:37.733538 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:41:37.994257 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:41:37.994407 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:41:38.102520 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:41:38.102687 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:41:38.312453 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:41:38.557570 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:41:38.558157 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:41:38.663969 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:41:38.663969 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:41:38.924405 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:41:39.188819 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:41:39.188819 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:41:39.298805 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:41:39.299787 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:41:39.508514 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:41:39.802764 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:41:39.802764 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:41:39.925296 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:41:39.925296 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:41:40.206994 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:41:40.456941 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:41:40.456941 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:41:40.562068 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:41:40.562068 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:41:40.790703 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:41:41.059789 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:41:41.061050 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:41:41.161435 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:41:41.162202 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:41:41.388246 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:41:41.634029 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:41:41.634029 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:41:41.737760 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:41:41.739242 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:41:41.946578 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:41:42.202795 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:41:42.203242 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:41:42.325463 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:41:42.325631 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:41:42.560089 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:41:42.813727 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:41:42.813952 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:41:42.922480 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:41:42.922657 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:41:43.023050 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:41:43.143903 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:41:43.144052 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:41:43.227064 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:41:43.227469 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:41:43.235459 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:41:43.242912 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:41:43.243142 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:41:43.248441 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Completed fetching metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:121}} Jul 05 03:41:43.248629 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:41:43.252903 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:41:43.253233 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-425644664, sha256file filename: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:41:43.326298 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:41:43.327050 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-425644664, metadata filename: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:41:43.355041 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] _write_metadata finished. Metadata: b'{\n "backup_description": "tempest-backup-description-2103089490",\n "backup_id": "bfd97c4c-4d7c-482e-8b78-b55dba635d6b",\n "backup_name": "tempest-VolumesBackupsTest-Backup-217274326",\n "created_at": "2026-07-05 03:41:28+00:00",\n "objects": [\n {\n "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "1106b103-fed3-4d1b-afd3-ee05e186db26",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"1106b103-fed3-4d1b-afd3-ee05e186db26\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"e89d8ef0122f41c999bbb4d9fd9d8712\\", \\"project_id\\": \\"9ebf67ca50e54c89bb8084c855cb1e32\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:41:27.000000\\", \\"launched_at\\": \\"2026-07-05T03:41:27.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-961382523\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:41:26.000000\\", \\"updated_at\\": \\"2026-07-05T03:41:28.000000\\"}, \\"volume-metadata\\": {\\"vol-meta1\\": \\"value1\\", \\"vol-meta2\\": \\"value2\\", \\"vol-meta3\\": \\"value3\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:41:43.361290 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] backup bfd97c4c-4d7c-482e-8b78-b55dba635d6b finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:41:43.513003 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdk {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:41:43.540994 np0000004562 sudo[138200]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdk Jul 05 03:41:43.542172 np0000004562 sudo[138200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:41:43.948038 np0000004562 sudo[138200]: pam_unix(sudo:session): session closed for user root Jul 05 03:41:43.950416 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdk" returned: 0 in 0.441s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:41:43.951077 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1106b103-fed3-4d1b-afd3-ee05e186db26', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1106b103-fed3-4d1b-afd3-ee05e186db26', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799139', 'path': '/dev/sdk'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:41:43.951333 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:41:43.951872 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:41:43.952285 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1106b103-fed3-4d1b-afd3-ee05e186db26', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1106b103-fed3-4d1b-afd3-ee05e186db26', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-1106b103-fed3-4d1b-afd3-ee05e186db26 Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-ac752b8f-b0bd-47aa-907a-107c66209b94 Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:41:43.963679 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:41:43.964488 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:41:43.964488 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:41:43.964488 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:41:43.964488 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1106b103-fed3-4d1b-afd3-ee05e186db26', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:41:43.995502 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:43.995502 np0000004562 cinder-backup[101413]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:43.995502 np0000004562 cinder-backup[101413]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:41:43.995502 np0000004562 cinder-backup[101413]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:41:43.995502 np0000004562 cinder-backup[101413]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:43.995502 np0000004562 cinder-backup[101413]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:43.995502 np0000004562 cinder-backup[101413]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac752b8f-b0bd-47aa-907a-107c66209b94 (non-flash) Jul 05 03:41:43.995502 np0000004562 cinder-backup[101413]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac752b8f-b0bd-47aa-907a-107c66209b94 (non-flash) Jul 05 03:41:43.995502 np0000004562 cinder-backup[101413]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1106b103-fed3-4d1b-afd3-ee05e186db26 (non-flash) Jul 05 03:41:43.995502 np0000004562 cinder-backup[101413]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:43.995502 np0000004562 cinder-backup[101413]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:43.995502 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:41:43.995905 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:43.995905 np0000004562 cinder-backup[101413]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:43.995905 np0000004562 cinder-backup[101413]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:41:43.995905 np0000004562 cinder-backup[101413]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2 (non-flash) Jul 05 03:41:43.995905 np0000004562 cinder-backup[101413]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:43.995905 np0000004562 cinder-backup[101413]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:43.995905 np0000004562 cinder-backup[101413]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac752b8f-b0bd-47aa-907a-107c66209b94 (non-flash) Jul 05 03:41:43.995905 np0000004562 cinder-backup[101413]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac752b8f-b0bd-47aa-907a-107c66209b94 (non-flash) Jul 05 03:41:43.995905 np0000004562 cinder-backup[101413]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1106b103-fed3-4d1b-afd3-ee05e186db26 (non-flash) Jul 05 03:41:43.995905 np0000004562 cinder-backup[101413]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:43.995905 np0000004562 cinder-backup[101413]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:43.995905 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:41:43.996121 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6', '115'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2', '117'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8162f67a-5756-4bc0-ad8d-c1b7dd9f37a2', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390', '122'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390', '123'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac752b8f-b0bd-47aa-907a-107c66209b94', '129'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac752b8f-b0bd-47aa-907a-107c66209b94', '130'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1106b103-fed3-4d1b-afd3-ee05e186db26', '131'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce', '98'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce', '99')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:41:43.996275 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1106b103-fed3-4d1b-afd3-ee05e186db26, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1106b103-fed3-4d1b-afd3-ee05e186db26', '131')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:41:43.997754 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Resulting device map defaultdict(. at 0x72a48ebffa60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1106b103-fed3-4d1b-afd3-ee05e186db26'): ({'sdk'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:41:43.997877 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Removing single pathed devices sdk {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:41:44.009193 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Flushing IO for device /dev/sdk {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:41:44.017400 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:41:44.070504 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Checking to see if SCSI volumes sdk have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:41:44.070870 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] SCSI volumes sdk have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:41:44.072504 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Checking to see if device paths {'sdk'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:41:44.084577 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Device paths {'sdk'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:41:44.084982 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1106b103-fed3-4d1b-afd3-ee05e186db26')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:41:44.098493 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:41:44.131652 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 131, target: iqn.2023-03.storpool.com:os--volume-1106b103-fed3-4d1b-afd3-ee05e186db26, portal: 192.168.40.100,3260] Jul 05 03:41:44.131652 np0000004562 cinder-backup[101413]: Logout of [sid: 131, target: iqn.2023-03.storpool.com:os--volume-1106b103-fed3-4d1b-afd3-ee05e186db26, portal: 192.168.40.100,3260] successful. Jul 05 03:41:44.131652 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:41:44.150475 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:41:44.150708 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.199s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:41:44.150903 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] <== disconnect_volume: return (199ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:41:45.162117 np0000004562 cinder-backup[101413]: DEBUG dbcounter [-] [101413] Writing DB stats cinder:SELECT=125,cinder:UPDATE=19,cinder:INSERT=17 {{(pid=101413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:41:45.185103 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-69ba2a2d-3891-4f10-a395-104ec70f3c5e tempest-VolumesBackupsTest-551128076 None] Create backup finished. backup: bfd97c4c-4d7c-482e-8b78-b55dba635d6b. Jul 05 03:41:47.425937 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Restore backup started, backup: bfd97c4c-4d7c-482e-8b78-b55dba635d6b volume: e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642. Jul 05 03:41:47.439594 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_9ebf67ca50e54c89bb8084c855cb1e32 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:41:47.439819 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:41:47.440322 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:41:47.454748 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:41:47.478487 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:41:47.492876 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:41:47.493154 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:41:47.505966 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:41:47.508024 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe32:6af1', 'fe80::c8e9:89ff:febf:bf90', 'fe80::f816:3eff:fe03:899f', 'fe80::e075:aff:fed9:9a2e', 'fe80::f816:3eff:fe69:1b49', 'fe80::f816:3eff:fe1e:276c', 'fe80::14f3:d8ff:fe98:6988', 'fe80::f816:3eff:fe99:68b5', 'fe80::f816:3eff:fe91:a671', 'fe80::4871:a0ff:feb5:e1d', 'fe80::f816:3eff:fe80:7c1b', 'fe80::f816:3eff:fe92:c48f', 'fe80::80e7:33ff:fe1d:273b'] Jul 05 03:41:47.508289 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:41:47.508481 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:41:47.508854 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] <== get_connector_properties: return (67ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:41:48.517831 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:41:48.518281 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:41:48.518383 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:41:48.518870 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:41:48.519085 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:41:48.530118 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:41:48.530583 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:41:48.530855 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:41:48.541912 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:41:48.541912 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:41:48.552677 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642] added Jul 05 03:41:48.552677 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:41:48.552677 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:41:48.552677 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:41:48.552677 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:41:48.552677 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:41:48.552677 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:41:48.552963 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:41:48.553426 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0225(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:41:48.553641 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:41:49.554523 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:41:49.565819 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:41:49.581462 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:41:49.600939 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:49.600939 np0000004562 cinder-backup[101413]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:49.600939 np0000004562 cinder-backup[101413]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:49.600939 np0000004562 cinder-backup[101413]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:49.600939 np0000004562 cinder-backup[101413]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac752b8f-b0bd-47aa-907a-107c66209b94 (non-flash) Jul 05 03:41:49.600939 np0000004562 cinder-backup[101413]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac752b8f-b0bd-47aa-907a-107c66209b94 (non-flash) Jul 05 03:41:49.600939 np0000004562 cinder-backup[101413]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:49.600939 np0000004562 cinder-backup[101413]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:49.600939 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:41:49.601304 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:49.601304 np0000004562 cinder-backup[101413]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:49.601304 np0000004562 cinder-backup[101413]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:49.601304 np0000004562 cinder-backup[101413]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:49.601304 np0000004562 cinder-backup[101413]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac752b8f-b0bd-47aa-907a-107c66209b94 (non-flash) Jul 05 03:41:49.601304 np0000004562 cinder-backup[101413]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac752b8f-b0bd-47aa-907a-107c66209b94 (non-flash) Jul 05 03:41:49.601304 np0000004562 cinder-backup[101413]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:49.601304 np0000004562 cinder-backup[101413]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:49.601304 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:41:49.642928 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642, portal: 192.168.40.100,3260] Jul 05 03:41:49.642928 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642, portal: 192.168.40.100,3260] successful. Jul 05 03:41:49.642928 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:41:49.654636 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:41:49.675889 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:49.675889 np0000004562 cinder-backup[101413]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:49.675889 np0000004562 cinder-backup[101413]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:49.675889 np0000004562 cinder-backup[101413]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:49.675889 np0000004562 cinder-backup[101413]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac752b8f-b0bd-47aa-907a-107c66209b94 (non-flash) Jul 05 03:41:49.675889 np0000004562 cinder-backup[101413]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac752b8f-b0bd-47aa-907a-107c66209b94 (non-flash) Jul 05 03:41:49.675889 np0000004562 cinder-backup[101413]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642 (non-flash) Jul 05 03:41:49.675889 np0000004562 cinder-backup[101413]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:49.675889 np0000004562 cinder-backup[101413]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:49.675889 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:41:49.676317 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:49.676317 np0000004562 cinder-backup[101413]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:49.676317 np0000004562 cinder-backup[101413]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:49.676317 np0000004562 cinder-backup[101413]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:49.676317 np0000004562 cinder-backup[101413]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac752b8f-b0bd-47aa-907a-107c66209b94 (non-flash) Jul 05 03:41:49.676317 np0000004562 cinder-backup[101413]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac752b8f-b0bd-47aa-907a-107c66209b94 (non-flash) Jul 05 03:41:49.676317 np0000004562 cinder-backup[101413]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642 (non-flash) Jul 05 03:41:49.676317 np0000004562 cinder-backup[101413]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:49.676317 np0000004562 cinder-backup[101413]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:49.676317 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:41:49.676585 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.146s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:41:49.676670 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:41:49.677623 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] HCTL ('7', '-', '-', 0) found on session 132 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:41:49.677799 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:41:49.693084 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Searching for a device in session 132 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:41:49.694581 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:41:50.696595 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.178s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:41:50.697028 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] <== connect_volume: return (2178ms) {'type': 'block', 'scsi_wwn': '33000000062a25f64', 'path': '/dev/sdb'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:41:50.697183 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:41:50.715654 np0000004562 sudo[138432]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 05 03:41:50.716515 np0000004562 sudo[138432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:41:51.056389 np0000004562 sudo[138432]: pam_unix(sudo:session): session closed for user root Jul 05 03:41:51.058767 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.361s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:41:51.059199 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] starting restore of backup volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b container: tempest-volumesbackupstest-backup-container-425644664, to new volume e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642, backup: bfd97c4c-4d7c-482e-8b78-b55dba635d6b. {{(pid=101413) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jul 05 03:41:51.059372 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] _read_metadata started, container name: tempest-volumesbackupstest-backup-container-425644664, metadata filename: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b_metadata. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] _read_metadata finished. Metadata: { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "backup_description": "tempest-backup-description-2103089490", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "backup_id": "bfd97c4c-4d7c-482e-8b78-b55dba635d6b", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "backup_name": "tempest-VolumesBackupsTest-Backup-217274326", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "created_at": "2026-07-05 03:41:28+00:00", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "objects": [ Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00001": { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "offset": 0 Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00002": { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "offset": 52428800 Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00003": { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "offset": 104857600 Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00004": { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "offset": 157286400 Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00005": { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "offset": 209715200 Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00006": { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "offset": 262144000 Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00007": { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "offset": 314572800 Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00008": { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "offset": 367001600 Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00009": { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "offset": 419430400 Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00010": { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "offset": 471859200 Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00011": { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "offset": 524288000 Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00012": { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "offset": 576716800 Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00013": { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "offset": 629145600 Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00014": { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "offset": 681574400 Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00015": { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "offset": 734003200 Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00016": { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "offset": 786432000 Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00017": { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "offset": 838860800 Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00018": { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "offset": 891289600 Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00019": { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "offset": 943718400 Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00020": { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "offset": 996147200 Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00021": { Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "length": 25165824, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "offset": 1048576000 Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: ], Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "parent_id": null, Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "version": "1.0.0", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "volume_id": "1106b103-fed3-4d1b-afd3-ee05e186db26", Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"1106b103-fed3-4d1b-afd3-ee05e186db26\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"e89d8ef0122f41c999bbb4d9fd9d8712\", \"project_id\": \"9ebf67ca50e54c89bb8084c855cb1e32\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004562@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T03:41:27.000000\", \"launched_at\": \"2026-07-05T03:41:27.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-961382523\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"ac464b70-f08d-447b-aa26-2823b4948fc2\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T03:41:26.000000\", \"updated_at\": \"2026-07-05T03:41:28.000000\"}, \"volume-metadata\": {\"vol-meta1\": \"value1\", \"vol-meta2\": \"value2\", \"vol-meta3\": \"value3\"}}" Jul 05 03:41:51.077290 np0000004562 cinder-backup[101413]: }. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 03:41:51.084465 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Restoring backup version 1.0.0 {{(pid=101413) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jul 05 03:41:51.084465 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] _read_metadata started, container name: tempest-volumesbackupstest-backup-container-425644664, metadata filename: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b_metadata. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] _read_metadata finished. Metadata: { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "backup_description": "tempest-backup-description-2103089490", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "backup_id": "bfd97c4c-4d7c-482e-8b78-b55dba635d6b", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "backup_name": "tempest-VolumesBackupsTest-Backup-217274326", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "created_at": "2026-07-05 03:41:28+00:00", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "objects": [ Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00001": { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "offset": 0 Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00002": { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "offset": 52428800 Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00003": { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "offset": 104857600 Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00004": { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "offset": 157286400 Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00005": { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "offset": 209715200 Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00006": { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "offset": 262144000 Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00007": { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "offset": 314572800 Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00008": { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "offset": 367001600 Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00009": { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "offset": 419430400 Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00010": { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "offset": 471859200 Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00011": { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "offset": 524288000 Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00012": { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "offset": 576716800 Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00013": { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "offset": 629145600 Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00014": { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "offset": 681574400 Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00015": { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "offset": 734003200 Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00016": { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "offset": 786432000 Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00017": { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "offset": 838860800 Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00018": { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "offset": 891289600 Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00019": { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "offset": 943718400 Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00020": { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "offset": 996147200 Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: }, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00021": { Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "length": 25165824, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "offset": 1048576000 Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: } Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: ], Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "parent_id": null, Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "version": "1.0.0", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "volume_id": "1106b103-fed3-4d1b-afd3-ee05e186db26", Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"1106b103-fed3-4d1b-afd3-ee05e186db26\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"e89d8ef0122f41c999bbb4d9fd9d8712\", \"project_id\": \"9ebf67ca50e54c89bb8084c855cb1e32\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004562@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T03:41:27.000000\", \"launched_at\": \"2026-07-05T03:41:27.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-961382523\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"ac464b70-f08d-447b-aa26-2823b4948fc2\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T03:41:26.000000\", \"updated_at\": \"2026-07-05T03:41:28.000000\"}, \"volume-metadata\": {\"vol-meta1\": \"value1\", \"vol-meta2\": \"value2\", \"vol-meta3\": \"value3\"}}" Jul 05 03:41:51.093028 np0000004562 cinder-backup[101413]: }. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 03:41:51.102120 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] v1 volume backup restore of bfd97c4c-4d7c-482e-8b78-b55dba635d6b started. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 05 03:41:51.102120 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] metadata_object_names = ['volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00001', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00002', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00003', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00004', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00005', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00006', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00007', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00008', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00009', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00010', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00011', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00012', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00013', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00014', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00015', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00016', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00017', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00018', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00019', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00020', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00021']. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 05 03:41:51.139955 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] generated object list: ['volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00001', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00002', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00003', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00004', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00005', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00006', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00007', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00008', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00009', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00010', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00011', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00012', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00013', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00014', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00015', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00016', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00017', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00018', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00019', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00020', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00021', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b_metadata', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:41:51.175450 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:41:51.179887 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: bfd97c4c-4d7c-482e-8b78-b55dba635d6b, container: tempest-volumesbackupstest-backup-container-425644664, object name: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00001, volume: e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:51.196173 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:51.581282 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: bfd97c4c-4d7c-482e-8b78-b55dba635d6b, container: tempest-volumesbackupstest-backup-container-425644664, object name: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00002, volume: e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:51.597762 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:51.923462 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: bfd97c4c-4d7c-482e-8b78-b55dba635d6b, container: tempest-volumesbackupstest-backup-container-425644664, object name: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00003, volume: e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:51.936342 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:52.305317 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: bfd97c4c-4d7c-482e-8b78-b55dba635d6b, container: tempest-volumesbackupstest-backup-container-425644664, object name: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00004, volume: e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:52.322179 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:52.679336 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: bfd97c4c-4d7c-482e-8b78-b55dba635d6b, container: tempest-volumesbackupstest-backup-container-425644664, object name: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00005, volume: e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:52.694479 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:53.017949 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: bfd97c4c-4d7c-482e-8b78-b55dba635d6b, container: tempest-volumesbackupstest-backup-container-425644664, object name: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00006, volume: e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:53.034004 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:53.373179 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: bfd97c4c-4d7c-482e-8b78-b55dba635d6b, container: tempest-volumesbackupstest-backup-container-425644664, object name: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00007, volume: e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:53.387511 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:53.769005 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: bfd97c4c-4d7c-482e-8b78-b55dba635d6b, container: tempest-volumesbackupstest-backup-container-425644664, object name: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00008, volume: e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:53.803919 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:54.166883 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: bfd97c4c-4d7c-482e-8b78-b55dba635d6b, container: tempest-volumesbackupstest-backup-container-425644664, object name: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00009, volume: e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:54.185248 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:54.517178 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: bfd97c4c-4d7c-482e-8b78-b55dba635d6b, container: tempest-volumesbackupstest-backup-container-425644664, object name: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00010, volume: e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:54.532020 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:54.863205 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: bfd97c4c-4d7c-482e-8b78-b55dba635d6b, container: tempest-volumesbackupstest-backup-container-425644664, object name: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00011, volume: e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:54.878180 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:55.214824 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: bfd97c4c-4d7c-482e-8b78-b55dba635d6b, container: tempest-volumesbackupstest-backup-container-425644664, object name: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00012, volume: e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:55.240746 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:55.601070 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: bfd97c4c-4d7c-482e-8b78-b55dba635d6b, container: tempest-volumesbackupstest-backup-container-425644664, object name: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00013, volume: e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:55.625062 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:55.972771 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: bfd97c4c-4d7c-482e-8b78-b55dba635d6b, container: tempest-volumesbackupstest-backup-container-425644664, object name: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00014, volume: e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:55.986627 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:56.316737 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: bfd97c4c-4d7c-482e-8b78-b55dba635d6b, container: tempest-volumesbackupstest-backup-container-425644664, object name: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00015, volume: e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:56.330628 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:56.678888 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: bfd97c4c-4d7c-482e-8b78-b55dba635d6b, container: tempest-volumesbackupstest-backup-container-425644664, object name: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00016, volume: e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:56.695912 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:57.034519 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: bfd97c4c-4d7c-482e-8b78-b55dba635d6b, container: tempest-volumesbackupstest-backup-container-425644664, object name: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00017, volume: e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:57.048755 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:57.435238 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: bfd97c4c-4d7c-482e-8b78-b55dba635d6b, container: tempest-volumesbackupstest-backup-container-425644664, object name: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00018, volume: e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:57.454829 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:57.819342 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: bfd97c4c-4d7c-482e-8b78-b55dba635d6b, container: tempest-volumesbackupstest-backup-container-425644664, object name: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00019, volume: e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:57.847215 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:58.187434 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: bfd97c4c-4d7c-482e-8b78-b55dba635d6b, container: tempest-volumesbackupstest-backup-container-425644664, object name: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00020, volume: e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:58.201919 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:58.541384 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] restoring object. backup: bfd97c4c-4d7c-482e-8b78-b55dba635d6b, container: tempest-volumesbackupstest-backup-container-425644664, object name: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00021, volume: e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:41:58.561634 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:41:58.727637 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] v1 volume backup restore of bfd97c4c-4d7c-482e-8b78-b55dba635d6b finished. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 05 03:41:58.728028 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Restoring volume base metadata {{(pid=101413) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 05 03:41:58.739369 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Restoring volume metadata {{(pid=101413) _restore_vol_meta /opt/stack/cinder/cinder/backup/driver.py:249}} Jul 05 03:41:58.752476 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=101413) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 05 03:41:58.752644 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] restore bfd97c4c-4d7c-482e-8b78-b55dba635d6b to e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642 finished. {{(pid=101413) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jul 05 03:41:58.753052 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:41:58.772839 np0000004562 sudo[138649]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 05 03:41:58.773434 np0000004562 sudo[138649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:41:59.112292 np0000004562 sudo[138649]: pam_unix(sudo:session): session closed for user root Jul 05 03:41:59.114606 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.361s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:41:59.114937 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '33000000062a25f64', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:41:59.115133 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:41:59.668927 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.553s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:41:59.669866 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-8203dec6-ce9c-4fea-a263-ce5ffb75dcec Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642 Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-ac752b8f-b0bd-47aa-907a-107c66209b94 Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:41:59.682659 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:41:59.683295 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:41:59.683295 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:41:59.683295 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:41:59.683295 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:41:59.715057 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:59.715057 np0000004562 cinder-backup[101413]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:59.715057 np0000004562 cinder-backup[101413]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:59.715057 np0000004562 cinder-backup[101413]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:59.715057 np0000004562 cinder-backup[101413]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac752b8f-b0bd-47aa-907a-107c66209b94 (non-flash) Jul 05 03:41:59.715057 np0000004562 cinder-backup[101413]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac752b8f-b0bd-47aa-907a-107c66209b94 (non-flash) Jul 05 03:41:59.715057 np0000004562 cinder-backup[101413]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642 (non-flash) Jul 05 03:41:59.715057 np0000004562 cinder-backup[101413]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8203dec6-ce9c-4fea-a263-ce5ffb75dcec (non-flash) Jul 05 03:41:59.715057 np0000004562 cinder-backup[101413]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8203dec6-ce9c-4fea-a263-ce5ffb75dcec (non-flash) Jul 05 03:41:59.715057 np0000004562 cinder-backup[101413]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:59.715057 np0000004562 cinder-backup[101413]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:59.715057 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:41:59.715480 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:59.715480 np0000004562 cinder-backup[101413]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6 (non-flash) Jul 05 03:41:59.715480 np0000004562 cinder-backup[101413]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:59.715480 np0000004562 cinder-backup[101413]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390 (non-flash) Jul 05 03:41:59.715480 np0000004562 cinder-backup[101413]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac752b8f-b0bd-47aa-907a-107c66209b94 (non-flash) Jul 05 03:41:59.715480 np0000004562 cinder-backup[101413]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac752b8f-b0bd-47aa-907a-107c66209b94 (non-flash) Jul 05 03:41:59.715480 np0000004562 cinder-backup[101413]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642 (non-flash) Jul 05 03:41:59.715480 np0000004562 cinder-backup[101413]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8203dec6-ce9c-4fea-a263-ce5ffb75dcec (non-flash) Jul 05 03:41:59.715480 np0000004562 cinder-backup[101413]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8203dec6-ce9c-4fea-a263-ce5ffb75dcec (non-flash) Jul 05 03:41:59.715480 np0000004562 cinder-backup[101413]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:59.715480 np0000004562 cinder-backup[101413]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce (non-flash) Jul 05 03:41:59.715480 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:41:59.715480 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6', '115'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-122cdbec-9766-40f8-a90b-2275668b51e6', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390', '122'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b0f3c6e-c86c-4eff-b9af-59faf2c53390', '123'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac752b8f-b0bd-47aa-907a-107c66209b94', '129'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac752b8f-b0bd-47aa-907a-107c66209b94', '130'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642', '132'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8203dec6-ce9c-4fea-a263-ce5ffb75dcec', '133'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8203dec6-ce9c-4fea-a263-ce5ffb75dcec', '134'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce', '98'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72b07a53-cf4f-44b9-b381-e9dd8b74b1ce', '99')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:41:59.715993 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642', '132')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:41:59.717062 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Resulting device map defaultdict(. at 0x72a470546020>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642'): ({'sdb'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:41:59.717356 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Removing single pathed devices sdb {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:41:59.729923 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Flushing IO for device /dev/sdb {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:41:59.738596 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:41:59.792199 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:41:59.792734 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:41:59.794314 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:41:59.805118 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:41:59.805479 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:41:59.817629 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:41:59.859646 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 132, target: iqn.2023-03.storpool.com:os--volume-e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642, portal: 192.168.40.100,3260] Jul 05 03:41:59.859646 np0000004562 cinder-backup[101413]: Logout of [sid: 132, target: iqn.2023-03.storpool.com:os--volume-e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642, portal: 192.168.40.100,3260] successful. Jul 05 03:41:59.859646 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:41:59.880211 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:41:59.880511 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.212s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:41:59.880760 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] <== disconnect_volume: return (766ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:42:00.898995 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.manager [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Encryption key ID for volume e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642 already matches encryption key ID in backup bfd97c4c-4d7c-482e-8b78-b55dba635d6b. {{(pid=101413) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jul 05 03:42:00.926370 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-431d7055-2a08-460e-8e5c-a70249e643c8 tempest-VolumesBackupsTest-551128076 None] Finished restoring backup bfd97c4c-4d7c-482e-8b78-b55dba635d6b to volume e667d4f3-a6a3-4ec1-bc59-bd0e56ea1642. Jul 05 03:42:02.967438 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-d1d2a191-4603-4ff3-93a2-689ca1780ab2 tempest-VolumesBackupsTest-551128076 None] Delete backup started, backup: bfd97c4c-4d7c-482e-8b78-b55dba635d6b. Jul 05 03:42:02.973785 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-d1d2a191-4603-4ff3-93a2-689ca1780ab2 tempest-VolumesBackupsTest-551128076 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_9ebf67ca50e54c89bb8084c855cb1e32 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:42:02.974123 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-d1d2a191-4603-4ff3-93a2-689ca1780ab2 tempest-VolumesBackupsTest-551128076 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:42:02.974374 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d1d2a191-4603-4ff3-93a2-689ca1780ab2 tempest-VolumesBackupsTest-551128076 None] delete started, backup: bfd97c4c-4d7c-482e-8b78-b55dba635d6b, container: tempest-volumesbackupstest-backup-container-425644664, prefix: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:42:03.017170 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d1d2a191-4603-4ff3-93a2-689ca1780ab2 tempest-VolumesBackupsTest-551128076 None] generated object list: ['volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00001', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00002', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00003', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00004', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00005', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00006', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00007', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00008', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00009', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00010', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00011', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00012', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00013', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00014', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00015', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00016', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00017', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00018', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00019', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00020', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00021', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b_metadata', 'volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:42:03.042811 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d1d2a191-4603-4ff3-93a2-689ca1780ab2 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00001 in container: tempest-volumesbackupstest-backup-container-425644664. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:42:03.078804 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d1d2a191-4603-4ff3-93a2-689ca1780ab2 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00002 in container: tempest-volumesbackupstest-backup-container-425644664. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:42:03.107312 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d1d2a191-4603-4ff3-93a2-689ca1780ab2 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00003 in container: tempest-volumesbackupstest-backup-container-425644664. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:42:03.136661 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d1d2a191-4603-4ff3-93a2-689ca1780ab2 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00004 in container: tempest-volumesbackupstest-backup-container-425644664. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:42:03.164026 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d1d2a191-4603-4ff3-93a2-689ca1780ab2 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00005 in container: tempest-volumesbackupstest-backup-container-425644664. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:42:03.184629 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d1d2a191-4603-4ff3-93a2-689ca1780ab2 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00006 in container: tempest-volumesbackupstest-backup-container-425644664. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:42:03.206672 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d1d2a191-4603-4ff3-93a2-689ca1780ab2 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00007 in container: tempest-volumesbackupstest-backup-container-425644664. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:42:03.233113 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d1d2a191-4603-4ff3-93a2-689ca1780ab2 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00008 in container: tempest-volumesbackupstest-backup-container-425644664. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:42:03.258642 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d1d2a191-4603-4ff3-93a2-689ca1780ab2 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00009 in container: tempest-volumesbackupstest-backup-container-425644664. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:42:03.286000 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d1d2a191-4603-4ff3-93a2-689ca1780ab2 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00010 in container: tempest-volumesbackupstest-backup-container-425644664. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:42:03.314691 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d1d2a191-4603-4ff3-93a2-689ca1780ab2 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00011 in container: tempest-volumesbackupstest-backup-container-425644664. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:42:03.344864 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d1d2a191-4603-4ff3-93a2-689ca1780ab2 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00012 in container: tempest-volumesbackupstest-backup-container-425644664. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:42:03.371272 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d1d2a191-4603-4ff3-93a2-689ca1780ab2 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00013 in container: tempest-volumesbackupstest-backup-container-425644664. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:42:03.397743 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d1d2a191-4603-4ff3-93a2-689ca1780ab2 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00014 in container: tempest-volumesbackupstest-backup-container-425644664. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:42:03.424672 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d1d2a191-4603-4ff3-93a2-689ca1780ab2 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00015 in container: tempest-volumesbackupstest-backup-container-425644664. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:42:03.448428 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d1d2a191-4603-4ff3-93a2-689ca1780ab2 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00016 in container: tempest-volumesbackupstest-backup-container-425644664. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:42:03.472338 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d1d2a191-4603-4ff3-93a2-689ca1780ab2 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00017 in container: tempest-volumesbackupstest-backup-container-425644664. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:42:03.494747 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d1d2a191-4603-4ff3-93a2-689ca1780ab2 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00018 in container: tempest-volumesbackupstest-backup-container-425644664. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:42:03.518197 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d1d2a191-4603-4ff3-93a2-689ca1780ab2 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00019 in container: tempest-volumesbackupstest-backup-container-425644664. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:42:03.538983 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d1d2a191-4603-4ff3-93a2-689ca1780ab2 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00020 in container: tempest-volumesbackupstest-backup-container-425644664. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:42:03.559915 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d1d2a191-4603-4ff3-93a2-689ca1780ab2 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b-00021 in container: tempest-volumesbackupstest-backup-container-425644664. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:42:03.583932 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d1d2a191-4603-4ff3-93a2-689ca1780ab2 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b_metadata in container: tempest-volumesbackupstest-backup-container-425644664. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:42:03.605352 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d1d2a191-4603-4ff3-93a2-689ca1780ab2 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_1106b103-fed3-4d1b-afd3-ee05e186db26/20260705034130/az_nova_backup_bfd97c4c-4d7c-482e-8b78-b55dba635d6b_sha256file in container: tempest-volumesbackupstest-backup-container-425644664. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:42:03.605576 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d1d2a191-4603-4ff3-93a2-689ca1780ab2 tempest-VolumesBackupsTest-551128076 None] delete bfd97c4c-4d7c-482e-8b78-b55dba635d6b finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:42:03.664490 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-d1d2a191-4603-4ff3-93a2-689ca1780ab2 tempest-VolumesBackupsTest-551128076 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:42:03.679548 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-d1d2a191-4603-4ff3-93a2-689ca1780ab2 tempest-VolumesBackupsTest-551128076 None] Created reservations ['759cdc0e-318b-4736-b3f9-d5e8e02020d1', '1e08808e-07ff-4601-a236-8366357cc4bf'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:42:03.695738 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-d1d2a191-4603-4ff3-93a2-689ca1780ab2 tempest-VolumesBackupsTest-551128076 None] Delete backup finished, backup bfd97c4c-4d7c-482e-8b78-b55dba635d6b deleted. Jul 05 03:42:11.773412 np0000004562 cinder-backup[101413]: DEBUG oslo_service.periodic_task [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:42:11.774046 np0000004562 cinder-backup[101413]: DEBUG cinder.manager [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Notifying Schedulers of capabilities ... {{(pid=101413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:42:13.693137 np0000004562 cinder-backup[101413]: DEBUG dbcounter [-] [101413] Writing DB stats cinder:UPDATE=13,cinder:SELECT=38,cinder:INSERT=4 {{(pid=101413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:43:08.644099 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Create backup started, backup: 0ea5ca0d-7367-454b-a631-0d9f828db381 volume: 98295ac8-1979-4056-8a5b-bb5d71f20e92. Jul 05 03:43:08.649340 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T03:43:08Z,data_timestamp=2026-07-05T03:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-912020007',encryption_key_id=None,fail_reason=None,host='np0000004562',id=0ea5ca0d-7367-454b-a631-0d9f828db381,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='4891f452f0954ca2ab42df311c6d7f91',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='b7fc80cd98414492aad9972b4676fdb6',volume_id=98295ac8-1979-4056-8a5b-bb5d71f20e92) Jul 05 03:43:08.679017 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_4891f452f0954ca2ab42df311c6d7f91 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:43:08.679440 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:43:08.679835 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:43:08.693525 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:43:08.715880 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:43:08.729891 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:43:08.730272 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:43:08.738699 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:43:08.739886 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe1a:265c', 'fe80::689e:ddff:fe47:c424', 'fe80::f816:3eff:fe5f:5f4f', 'fe80::e075:aff:fed9:9a2e', 'fe80::f816:3eff:fe92:c48f', 'fe80::80e7:33ff:fe1d:273b', 'fe80::f816:3eff:feec:87ae', 'fe80::4871:a0ff:feb5:e1d'] Jul 05 03:43:08.740083 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:43:08.740265 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:43:08.740576 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] <== get_connector_properties: return (60ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:43:09.244229 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:43:09.244807 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '98295ac8-1979-4056-8a5b-bb5d71f20e92', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:43:09.245023 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:43:11.777776 np0000004562 cinder-backup[101413]: DEBUG oslo_service.periodic_task [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:43:11.778264 np0000004562 cinder-backup[101413]: DEBUG cinder.manager [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Notifying Schedulers of capabilities ... {{(pid=101413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:43:14.120327 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 4.875s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:43:14.120785 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '98295ac8-1979-4056-8a5b-bb5d71f20e92', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:43:14.132407 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:43:14.133170 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:43:14.133355 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:43:14.142948 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:43:14.142948 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:14.154356 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92] added Jul 05 03:43:14.154356 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:43:14.154356 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:43:14.154356 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:43:14.154356 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:43:14.154356 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:43:14.154356 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:14.154545 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:43:14.154955 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0215(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:43:14.155147 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:43:14.647267 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:43:14.655136 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Create backup started, backup: 8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2 volume: 04edf182-6b4b-4ca0-a438-23709fa3e558. Jul 05 03:43:14.661319 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-1257406501',created_at=2026-07-05T03:43:14Z,data_timestamp=2026-07-05T03:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1110393297',encryption_key_id=None,fail_reason=None,host='np0000004562',id=8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='9ebf67ca50e54c89bb8084c855cb1e32',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='e89d8ef0122f41c999bbb4d9fd9d8712',volume_id=04edf182-6b4b-4ca0-a438-23709fa3e558) Jul 05 03:43:14.742103 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_9ebf67ca50e54c89bb8084c855cb1e32 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:43:14.742311 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:43:14.742644 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:43:14.753802 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:43:14.776411 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:43:14.787706 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:43:14.788028 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:43:14.798804 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:43:14.799984 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe1a:265c', 'fe80::689e:ddff:fe47:c424', 'fe80::f816:3eff:fe5f:5f4f', 'fe80::e075:aff:fed9:9a2e', 'fe80::f816:3eff:fe92:c48f', 'fe80::80e7:33ff:fe1d:273b', 'fe80::f816:3eff:feec:87ae', 'fe80::4871:a0ff:feb5:e1d', 'fe80::f816:3eff:fe6c:6eb0', 'fe80::2c3f:65ff:fe45:1d49', 'fe80::f816:3eff:fe1c:1fed', 'fe80::e477:baff:fee9:cab5'] Jul 05 03:43:14.800098 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:43:14.800218 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:43:14.800445 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] <== get_connector_properties: return (57ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:43:15.156144 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:43:15.168109 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:15.179726 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:15.200415 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('-m', 'session'): stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3da7cc25-035b-4738-82c6-082a49816782 (non-flash) Jul 05 03:43:15.200415 np0000004562 cinder-backup[101413]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3da7cc25-035b-4738-82c6-082a49816782 (non-flash) Jul 05 03:43:15.200415 np0000004562 cinder-backup[101413]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-327f5004-fc4e-4484-925f-34defcfb3560 (non-flash) Jul 05 03:43:15.200415 np0000004562 cinder-backup[101413]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-327f5004-fc4e-4484-925f-34defcfb3560 (non-flash) Jul 05 03:43:15.200415 np0000004562 cinder-backup[101413]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:15.200415 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:15.200415 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:15.200415 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:15.200415 np0000004562 cinder-backup[101413]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02cd754d-9b3b-48d5-bdd7-49d82e22478b (non-flash) Jul 05 03:43:15.200415 np0000004562 cinder-backup[101413]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02cd754d-9b3b-48d5-bdd7-49d82e22478b (non-flash) Jul 05 03:43:15.200415 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:43:15.200910 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] iscsi session list stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3da7cc25-035b-4738-82c6-082a49816782 (non-flash) Jul 05 03:43:15.200910 np0000004562 cinder-backup[101413]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3da7cc25-035b-4738-82c6-082a49816782 (non-flash) Jul 05 03:43:15.200910 np0000004562 cinder-backup[101413]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-327f5004-fc4e-4484-925f-34defcfb3560 (non-flash) Jul 05 03:43:15.200910 np0000004562 cinder-backup[101413]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-327f5004-fc4e-4484-925f-34defcfb3560 (non-flash) Jul 05 03:43:15.200910 np0000004562 cinder-backup[101413]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:15.200910 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:15.200910 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:15.200910 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:15.200910 np0000004562 cinder-backup[101413]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02cd754d-9b3b-48d5-bdd7-49d82e22478b (non-flash) Jul 05 03:43:15.200910 np0000004562 cinder-backup[101413]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02cd754d-9b3b-48d5-bdd7-49d82e22478b (non-flash) Jul 05 03:43:15.200910 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:43:15.240265 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92, portal: 192.168.40.100,3260] Jul 05 03:43:15.240265 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92, portal: 192.168.40.100,3260] successful. Jul 05 03:43:15.240265 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:15.251731 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:15.269098 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('-m', 'session'): stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3da7cc25-035b-4738-82c6-082a49816782 (non-flash) Jul 05 03:43:15.269098 np0000004562 cinder-backup[101413]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3da7cc25-035b-4738-82c6-082a49816782 (non-flash) Jul 05 03:43:15.269098 np0000004562 cinder-backup[101413]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-327f5004-fc4e-4484-925f-34defcfb3560 (non-flash) Jul 05 03:43:15.269098 np0000004562 cinder-backup[101413]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-327f5004-fc4e-4484-925f-34defcfb3560 (non-flash) Jul 05 03:43:15.269098 np0000004562 cinder-backup[101413]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:15.269098 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:15.269098 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:15.269098 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:15.269098 np0000004562 cinder-backup[101413]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02cd754d-9b3b-48d5-bdd7-49d82e22478b (non-flash) Jul 05 03:43:15.269098 np0000004562 cinder-backup[101413]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02cd754d-9b3b-48d5-bdd7-49d82e22478b (non-flash) Jul 05 03:43:15.269098 np0000004562 cinder-backup[101413]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92 (non-flash) Jul 05 03:43:15.269098 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:43:15.269389 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] iscsi session list stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3da7cc25-035b-4738-82c6-082a49816782 (non-flash) Jul 05 03:43:15.269389 np0000004562 cinder-backup[101413]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3da7cc25-035b-4738-82c6-082a49816782 (non-flash) Jul 05 03:43:15.269389 np0000004562 cinder-backup[101413]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-327f5004-fc4e-4484-925f-34defcfb3560 (non-flash) Jul 05 03:43:15.269389 np0000004562 cinder-backup[101413]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-327f5004-fc4e-4484-925f-34defcfb3560 (non-flash) Jul 05 03:43:15.269389 np0000004562 cinder-backup[101413]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:15.269389 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:15.269389 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:15.269389 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:15.269389 np0000004562 cinder-backup[101413]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02cd754d-9b3b-48d5-bdd7-49d82e22478b (non-flash) Jul 05 03:43:15.269389 np0000004562 cinder-backup[101413]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02cd754d-9b3b-48d5-bdd7-49d82e22478b (non-flash) Jul 05 03:43:15.269389 np0000004562 cinder-backup[101413]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92 (non-flash) Jul 05 03:43:15.269389 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:43:15.269863 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:43:15.270563 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:43:15.271622 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] HCTL ('17', '-', '-', 0) found on session 155 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:43:15.271839 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Scanning host 17 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:43:15.284989 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Searching for a device in session 155 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:43:15.284989 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '98295ac8-1979-4056-8a5b-bb5d71f20e92', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:43:15.305991 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:43:15.305991 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7c4ce54-a48a-4aab-be7b-916401dd2def', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7c4ce54-a48a-4aab-be7b-916401dd2def', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:43:15.308911 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:43:16.288877 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.169s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:43:16.292735 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] <== connect_volume: return (7046ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799150', 'path': '/dev/sdl'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:43:16.292735 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdl {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:43:16.303011 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.996s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:43:16.304293 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7c4ce54-a48a-4aab-be7b-916401dd2def', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7c4ce54-a48a-4aab-be7b-916401dd2def', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:43:16.315707 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b7c4ce54-a48a-4aab-be7b-916401dd2def" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:43:16.315707 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b7c4ce54-a48a-4aab-be7b-916401dd2def" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:43:16.315707 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:43:16.318184 np0000004562 sudo[144034]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdl Jul 05 03:43:16.319011 np0000004562 sudo[144034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:43:16.327693 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:43:16.327693 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:16.339026 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b7c4ce54-a48a-4aab-be7b-916401dd2def] added Jul 05 03:43:16.339026 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:43:16.339026 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:43:16.339026 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:43:16.339026 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:43:16.339026 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:43:16.339026 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:16.339026 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:43:16.339026 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.023(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:43:16.339026 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:43:16.626856 np0000004562 sudo[144034]: pam_unix(sudo:session): session closed for user root Jul 05 03:43:16.631738 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdl" returned: 0 in 0.337s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:43:16.667907 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:43:16.673510 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] _create_container started, container: volumebackups,backup: 0ea5ca0d-7367-454b-a631-0d9f828db381. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:43:16.897638 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] generate_object_name_prefix: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381 {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:43:16.906865 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] starting backup of volume: 98295ac8-1979-4056-8a5b-bb5d71f20e92, volume size: 1073741824, object names prefix volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:43:17.113834 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:17.340502 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-b7c4ce54-a48a-4aab-be7b-916401dd2def Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:43:17.355036 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:17.370058 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:17.370677 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:17.370958 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:17.391526 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] iscsiadm ('-m', 'session'): stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3da7cc25-035b-4738-82c6-082a49816782 (non-flash) Jul 05 03:43:17.391526 np0000004562 cinder-backup[101413]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3da7cc25-035b-4738-82c6-082a49816782 (non-flash) Jul 05 03:43:17.391526 np0000004562 cinder-backup[101413]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-327f5004-fc4e-4484-925f-34defcfb3560 (non-flash) Jul 05 03:43:17.391526 np0000004562 cinder-backup[101413]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-327f5004-fc4e-4484-925f-34defcfb3560 (non-flash) Jul 05 03:43:17.391526 np0000004562 cinder-backup[101413]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:17.391526 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:17.391526 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:17.391526 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:17.391526 np0000004562 cinder-backup[101413]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02cd754d-9b3b-48d5-bdd7-49d82e22478b (non-flash) Jul 05 03:43:17.391526 np0000004562 cinder-backup[101413]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02cd754d-9b3b-48d5-bdd7-49d82e22478b (non-flash) Jul 05 03:43:17.391526 np0000004562 cinder-backup[101413]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92 (non-flash) Jul 05 03:43:17.391526 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:43:17.391526 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] iscsi session list stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3da7cc25-035b-4738-82c6-082a49816782 (non-flash) Jul 05 03:43:17.391526 np0000004562 cinder-backup[101413]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3da7cc25-035b-4738-82c6-082a49816782 (non-flash) Jul 05 03:43:17.391526 np0000004562 cinder-backup[101413]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-327f5004-fc4e-4484-925f-34defcfb3560 (non-flash) Jul 05 03:43:17.391526 np0000004562 cinder-backup[101413]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-327f5004-fc4e-4484-925f-34defcfb3560 (non-flash) Jul 05 03:43:17.391526 np0000004562 cinder-backup[101413]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:17.391526 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:17.391526 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:17.391526 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:17.391526 np0000004562 cinder-backup[101413]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02cd754d-9b3b-48d5-bdd7-49d82e22478b (non-flash) Jul 05 03:43:17.391526 np0000004562 cinder-backup[101413]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02cd754d-9b3b-48d5-bdd7-49d82e22478b (non-flash) Jul 05 03:43:17.391526 np0000004562 cinder-backup[101413]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92 (non-flash) Jul 05 03:43:17.391526 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:43:17.438962 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b7c4ce54-a48a-4aab-be7b-916401dd2def, portal: 192.168.40.100,3260] Jul 05 03:43:17.438962 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b7c4ce54-a48a-4aab-be7b-916401dd2def, portal: 192.168.40.100,3260] successful. Jul 05 03:43:17.438962 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:17.452067 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:17.468897 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] iscsiadm ('-m', 'session'): stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3da7cc25-035b-4738-82c6-082a49816782 (non-flash) Jul 05 03:43:17.468897 np0000004562 cinder-backup[101413]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3da7cc25-035b-4738-82c6-082a49816782 (non-flash) Jul 05 03:43:17.468897 np0000004562 cinder-backup[101413]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-327f5004-fc4e-4484-925f-34defcfb3560 (non-flash) Jul 05 03:43:17.468897 np0000004562 cinder-backup[101413]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-327f5004-fc4e-4484-925f-34defcfb3560 (non-flash) Jul 05 03:43:17.468897 np0000004562 cinder-backup[101413]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:17.468897 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:17.468897 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:17.468897 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:17.468897 np0000004562 cinder-backup[101413]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02cd754d-9b3b-48d5-bdd7-49d82e22478b (non-flash) Jul 05 03:43:17.468897 np0000004562 cinder-backup[101413]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02cd754d-9b3b-48d5-bdd7-49d82e22478b (non-flash) Jul 05 03:43:17.468897 np0000004562 cinder-backup[101413]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92 (non-flash) Jul 05 03:43:17.468897 np0000004562 cinder-backup[101413]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c4ce54-a48a-4aab-be7b-916401dd2def (non-flash) Jul 05 03:43:17.468897 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:43:17.470657 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] iscsi session list stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3da7cc25-035b-4738-82c6-082a49816782 (non-flash) Jul 05 03:43:17.470657 np0000004562 cinder-backup[101413]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3da7cc25-035b-4738-82c6-082a49816782 (non-flash) Jul 05 03:43:17.470657 np0000004562 cinder-backup[101413]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-327f5004-fc4e-4484-925f-34defcfb3560 (non-flash) Jul 05 03:43:17.470657 np0000004562 cinder-backup[101413]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-327f5004-fc4e-4484-925f-34defcfb3560 (non-flash) Jul 05 03:43:17.470657 np0000004562 cinder-backup[101413]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:17.470657 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:17.470657 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:17.470657 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:17.470657 np0000004562 cinder-backup[101413]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02cd754d-9b3b-48d5-bdd7-49d82e22478b (non-flash) Jul 05 03:43:17.470657 np0000004562 cinder-backup[101413]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02cd754d-9b3b-48d5-bdd7-49d82e22478b (non-flash) Jul 05 03:43:17.470657 np0000004562 cinder-backup[101413]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92 (non-flash) Jul 05 03:43:17.470657 np0000004562 cinder-backup[101413]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c4ce54-a48a-4aab-be7b-916401dd2def (non-flash) Jul 05 03:43:17.470657 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:43:17.471341 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b7c4ce54-a48a-4aab-be7b-916401dd2def" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.156s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:43:17.473734 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:43:17.473734 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] HCTL ('18', '-', '-', 0) found on session 156 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:43:17.473734 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Scanning host 18 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:43:17.490590 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Searching for a device in session 156 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:43:17.490590 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7c4ce54-a48a-4aab-be7b-916401dd2def', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7c4ce54-a48a-4aab-be7b-916401dd2def', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:43:17.505203 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:17.505415 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:17.724806 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:17.971227 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:17.971227 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:18.070064 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:18.070221 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:18.243766 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:18.491468 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.190s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:43:18.491912 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] <== connect_volume: return (3185ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799152', 'path': '/dev/sdm'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:43:18.492040 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdm {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:43:18.498621 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:18.498863 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:18.510161 np0000004562 sudo[144117]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdm Jul 05 03:43:18.510870 np0000004562 sudo[144117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:43:18.601776 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:18.601964 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:18.814073 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:18.832241 np0000004562 sudo[144117]: pam_unix(sudo:session): session closed for user root Jul 05 03:43:18.833986 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdm" returned: 0 in 0.342s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:43:18.841263 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] _create_container started, container: tempest-volumesbackupstest-backup-container-1257406501,backup: 8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:43:18.890486 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] generate_object_name_prefix: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2 {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:43:18.898663 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] starting backup of volume: 04edf182-6b4b-4ca0-a438-23709fa3e558, volume size: 1073741824, object names prefix volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:43:19.073521 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:19.073521 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:19.113111 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:19.194431 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:19.194431 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:19.373140 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:19.377240 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:19.377240 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:19.489734 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:19.489734 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:19.705521 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:19.717498 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:19.717630 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:19.827231 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:19.827413 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:19.948773 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:19.948891 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:20.041083 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:20.081798 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:20.081972 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:20.266705 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:20.281924 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:20.282090 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:20.389405 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:20.389636 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:20.569326 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:20.630937 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:20.631102 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:20.816126 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:20.816479 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:20.906128 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:20.906307 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:20.932341 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:20.932521 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:21.170674 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:21.196123 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:21.410983 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:21.411134 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:21.443253 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:21.443458 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:21.518265 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:21.518437 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:21.549813 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:21.550006 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:21.787313 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:21.814881 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:22.061454 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:22.061915 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:22.070990 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:22.071240 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:22.168084 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:22.168330 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:22.173190 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:22.173369 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:22.392359 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:22.443058 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:22.641371 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:22.641573 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:22.694835 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:22.694971 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:22.746291 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:22.746453 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:22.795046 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:22.795203 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:22.988275 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:23.037367 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:23.243488 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:23.243995 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:23.297309 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:23.297463 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:23.353732 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:23.353732 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:23.414512 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:23.414601 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:23.600657 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:23.646342 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:23.854294 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:23.854294 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:23.887775 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:23.887775 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:23.962683 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:23.962832 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:23.993175 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:23.993406 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:24.227740 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:24.251467 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:24.476120 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:24.476299 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:24.506945 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:24.507107 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:24.581543 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:24.581675 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:24.610706 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:24.610924 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:24.873499 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:24.898205 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:25.135242 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:25.135779 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:25.148730 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:25.148973 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:25.237958 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:25.238142 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:25.258552 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:25.258552 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:25.506115 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:25.516738 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:25.751252 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:25.751471 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:25.762298 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:25.762453 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:25.858988 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:25.859164 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:25.860348 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:25.860527 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:26.205957 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:26.208690 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:26.446587 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:26.446942 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:26.461664 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:26.461859 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:26.565636 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:26.565853 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:26.567125 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:26.567302 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:26.866214 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:26.870245 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:27.107725 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:27.107888 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:27.124397 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:27.124573 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:27.211725 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:27.211911 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:27.225433 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:27.225626 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:27.478994 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:27.488957 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:27.738985 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:27.738985 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:27.738985 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:27.738985 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:27.846271 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:27.846397 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:27.849821 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:27.849928 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:28.143338 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:28.146088 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:28.390454 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:28.390656 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:28.392456 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:28.392645 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:28.497774 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:28.498623 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:28.513483 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:28.513693 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:28.804271 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:28.805108 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:29.049516 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:29.049638 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:29.088987 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:29.089194 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:29.159936 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:29.160142 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:29.201686 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:29.201686 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:29.347544 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:29.411814 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:29.466176 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:29.466384 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:29.535914 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:29.536245 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:29.547109 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:43:29.555927 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:43:29.556143 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:43:29.561700 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:43:29.561935 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:43:29.566346 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:43:29.566643 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:43:29.630192 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:43:29.631179 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] _write_metadata started, container name: volumebackups, metadata filename: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:43:29.663657 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "0ea5ca0d-7367-454b-a631-0d9f828db381",\n "backup_name": "tempest-type-Backup-912020007",\n "created_at": "2026-07-05 03:43:09+00:00",\n "objects": [\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "98295ac8-1979-4056-8a5b-bb5d71f20e92",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"98295ac8-1979-4056-8a5b-bb5d71f20e92\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"b7fc80cd98414492aad9972b4676fdb6\\", \\"project_id\\": \\"4891f452f0954ca2ab42df311c6d7f91\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:43:07.000000\\", \\"launched_at\\": \\"2026-07-05T03:43:08.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1042948977\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:43:07.000000\\", \\"updated_at\\": \\"2026-07-05T03:43:09.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:43:29.676135 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] backup 0ea5ca0d-7367-454b-a631-0d9f828db381 finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:43:29.806849 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdl {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:43:29.814457 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:29.814729 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:29.827250 np0000004562 sudo[144284]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdl Jul 05 03:43:29.827926 np0000004562 sudo[144284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:43:29.937466 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:29.937658 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:30.134314 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:30.185384 np0000004562 sudo[144284]: pam_unix(sudo:session): session closed for user root Jul 05 03:43:30.186961 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdl" returned: 0 in 0.380s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:43:30.187427 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '98295ac8-1979-4056-8a5b-bb5d71f20e92', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799150', 'path': '/dev/sdl'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:43:30.187626 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:43:30.188004 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:43:30.188325 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '98295ac8-1979-4056-8a5b-bb5d71f20e92', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:43:30.198915 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:43:30.198915 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:43:30.198915 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:43:30.198915 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:43:30.198915 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:43:30.198915 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f Jul 05 03:43:30.198915 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:43:30.198915 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:30.198915 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:43:30.198915 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:30.198915 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-b7c4ce54-a48a-4aab-be7b-916401dd2def Jul 05 03:43:30.198915 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:43:30.198915 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:30.198915 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92 Jul 05 03:43:30.198915 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:43:30.198915 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:30.198915 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 Jul 05 03:43:30.198915 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:43:30.198915 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:30.198915 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:43:30.198915 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:30.198915 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:43:30.198915 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:43:30.198915 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:43:30.199529 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:43:30.199529 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:43:30.199529 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:43:30.199529 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:43:30.226891 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('-m', 'session'): stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:30.226891 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:30.226891 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:30.226891 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:30.226891 np0000004562 cinder-backup[101413]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92 (non-flash) Jul 05 03:43:30.226891 np0000004562 cinder-backup[101413]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c4ce54-a48a-4aab-be7b-916401dd2def (non-flash) Jul 05 03:43:30.226891 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:43:30.227157 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] iscsi session list stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:30.227157 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:30.227157 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:30.227157 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:30.227157 np0000004562 cinder-backup[101413]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92 (non-flash) Jul 05 03:43:30.227157 np0000004562 cinder-backup[101413]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c4ce54-a48a-4aab-be7b-916401dd2def (non-flash) Jul 05 03:43:30.227157 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:43:30.227381 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f', '149'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f', '150'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558', '152'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92', '155'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7c4ce54-a48a-4aab-be7b-916401dd2def', '156')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:43:30.227381 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92', '155')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:43:30.228429 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Resulting device map defaultdict(. at 0x72a4705c23e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92'): ({'sdl'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:43:30.228688 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Removing single pathed devices sdl {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:43:30.240958 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Flushing IO for device /dev/sdl {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:43:30.248964 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:43:30.311560 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Checking to see if SCSI volumes sdl have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:43:30.311789 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] SCSI volumes sdl have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:43:30.312792 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Checking to see if device paths {'sdl'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:43:30.325383 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Device paths {'sdl'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:43:30.325976 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:43:30.337158 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:30.375826 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 155, target: iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92, portal: 192.168.40.100,3260] Jul 05 03:43:30.375826 np0000004562 cinder-backup[101413]: Logout of [sid: 155, target: iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92, portal: 192.168.40.100,3260] successful. Jul 05 03:43:30.375826 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:30.386738 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:30.386738 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:30.391413 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:30.391815 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.204s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:43:30.392025 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] <== disconnect_volume: return (204ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:43:30.494001 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:30.494140 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:30.723760 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:30.968171 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:30.968365 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:31.074523 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:31.074523 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:31.270390 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:31.423415 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-e3c8a0a1-9b30-407e-9e20-3988ec528025 tempest-ProjectAdminTests33-657181126 None] Create backup finished. backup: 0ea5ca0d-7367-454b-a631-0d9f828db381. Jul 05 03:43:31.527002 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:31.527150 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:31.628176 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:31.628355 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:31.726183 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:31.842967 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:31.843144 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:31.901593 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] backup MD5 for volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:31.901825 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:31.908627 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:43:31.916287 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:43:31.916422 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:43:31.920804 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:43:31.920980 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:43:31.924034 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:43:31.924213 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-1257406501, sha256file filename: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:43:31.982344 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:43:31.983213 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-1257406501, metadata filename: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:43:32.010730 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1110393297",\n "created_at": "2026-07-05 03:43:15+00:00",\n "objects": [\n {\n "volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "04edf182-6b4b-4ca0-a438-23709fa3e558",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"04edf182-6b4b-4ca0-a438-23709fa3e558\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"e89d8ef0122f41c999bbb4d9fd9d8712\\", \\"project_id\\": \\"9ebf67ca50e54c89bb8084c855cb1e32\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"attached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:42:05.000000\\", \\"launched_at\\": \\"2026-07-05T03:42:06.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-645460743\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"in-use\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:42:05.000000\\", \\"updated_at\\": \\"2026-07-05T03:43:15.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:43:32.015006 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] backup 8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2 finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:43:32.138095 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdm {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:43:32.154849 np0000004562 sudo[144421]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdm Jul 05 03:43:32.155455 np0000004562 sudo[144421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:43:32.208444 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Create backup started, backup: 529d0366-7166-4b7c-9e66-8903464a068a volume: 98295ac8-1979-4056-8a5b-bb5d71f20e92. Jul 05 03:43:32.213804 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T03:43:32Z,data_timestamp=2026-07-05T03:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='np0000004562',id=529d0366-7166-4b7c-9e66-8903464a068a,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='4891f452f0954ca2ab42df311c6d7f91',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='b7fc80cd98414492aad9972b4676fdb6',volume_id=98295ac8-1979-4056-8a5b-bb5d71f20e92) Jul 05 03:43:32.241604 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_4891f452f0954ca2ab42df311c6d7f91 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:43:32.241820 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:43:32.242199 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:43:32.252156 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:43:32.272615 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:43:32.286546 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:43:32.286905 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:43:32.295910 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:43:32.296986 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe1a:265c', 'fe80::689e:ddff:fe47:c424', 'fe80::f816:3eff:feec:87ae', 'fe80::4871:a0ff:feb5:e1d', 'fe80::f816:3eff:fe6c:6eb0', 'fe80::2c3f:65ff:fe45:1d49', 'fe80::f816:3eff:fe92:c48f', 'fe80::80e7:33ff:fe1d:273b'] Jul 05 03:43:32.297122 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:43:32.297246 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:43:32.297463 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] <== get_connector_properties: return (54ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:43:32.456788 np0000004562 sudo[144421]: pam_unix(sudo:session): session closed for user root Jul 05 03:43:32.458655 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdm" returned: 0 in 0.321s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:43:32.459260 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7c4ce54-a48a-4aab-be7b-916401dd2def', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7c4ce54-a48a-4aab-be7b-916401dd2def', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799152', 'path': '/dev/sdm'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:43:32.459474 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:43:32.460064 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:43:32.460516 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7c4ce54-a48a-4aab-be7b-916401dd2def', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7c4ce54-a48a-4aab-be7b-916401dd2def', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:43:32.471858 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:43:32.471858 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:43:32.471858 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:43:32.471858 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:43:32.471858 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:43:32.471858 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f Jul 05 03:43:32.471858 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:43:32.471858 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:32.471858 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:43:32.471858 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:32.471858 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-b7c4ce54-a48a-4aab-be7b-916401dd2def Jul 05 03:43:32.471858 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:43:32.471858 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:32.471858 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 Jul 05 03:43:32.471858 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:43:32.471858 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:32.471858 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:43:32.471858 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:32.471858 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:43:32.471858 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:43:32.471858 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:43:32.472446 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:43:32.472446 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:43:32.472446 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:43:32.472446 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7c4ce54-a48a-4aab-be7b-916401dd2def', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:43:32.495912 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] iscsiadm ('-m', 'session'): stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:32.495912 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:32.495912 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:32.495912 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:32.495912 np0000004562 cinder-backup[101413]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c4ce54-a48a-4aab-be7b-916401dd2def (non-flash) Jul 05 03:43:32.495912 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:43:32.496210 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] iscsi session list stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:32.496210 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:32.496210 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:32.496210 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:32.496210 np0000004562 cinder-backup[101413]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c4ce54-a48a-4aab-be7b-916401dd2def (non-flash) Jul 05 03:43:32.496210 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:43:32.496210 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f', '149'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f', '150'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558', '152'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7c4ce54-a48a-4aab-be7b-916401dd2def', '156')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:43:32.496456 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b7c4ce54-a48a-4aab-be7b-916401dd2def, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7c4ce54-a48a-4aab-be7b-916401dd2def', '156')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:43:32.497187 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Resulting device map defaultdict(. at 0x72a46fd105e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7c4ce54-a48a-4aab-be7b-916401dd2def'): ({'sdm'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:43:32.497382 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Removing single pathed devices sdm {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:43:32.507257 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Flushing IO for device /dev/sdm {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:43:32.515780 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:43:32.574829 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Checking to see if SCSI volumes sdm have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:43:32.574829 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] SCSI volumes sdm have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:43:32.574829 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Checking to see if device paths {'sdm'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:43:32.584922 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Device paths {'sdm'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:43:32.585174 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7c4ce54-a48a-4aab-be7b-916401dd2def')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:43:32.597857 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:32.633669 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 156, target: iqn.2023-03.storpool.com:os--volume-b7c4ce54-a48a-4aab-be7b-916401dd2def, portal: 192.168.40.100,3260] Jul 05 03:43:32.633669 np0000004562 cinder-backup[101413]: Logout of [sid: 156, target: iqn.2023-03.storpool.com:os--volume-b7c4ce54-a48a-4aab-be7b-916401dd2def, portal: 192.168.40.100,3260] successful. Jul 05 03:43:32.633669 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:32.648350 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:32.648350 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.187s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:43:32.648350 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] <== disconnect_volume: return (187ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:43:32.801327 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:43:32.801757 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '98295ac8-1979-4056-8a5b-bb5d71f20e92', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:43:32.801757 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:43:32.801997 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:43:32.802173 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '98295ac8-1979-4056-8a5b-bb5d71f20e92', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:43:32.811005 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:43:32.811273 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:43:32.811442 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:43:32.819095 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:43:32.819095 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:32.827982 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92] added Jul 05 03:43:32.827982 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:43:32.827982 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:43:32.827982 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:43:32.827982 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:43:32.827982 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:43:32.827982 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:32.828235 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:43:32.828430 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0169(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:43:32.828620 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:43:33.686541 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:43:33.710273 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-89caa5cb-8db3-46df-9820-ec57a68529da tempest-VolumesBackupsTest-551128076 None] Create backup finished. backup: 8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2. Jul 05 03:43:33.830154 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:43:33.839272 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:33.848554 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:33.858634 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] iscsiadm ('-m', 'session'): stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:33.858634 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:33.858634 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:33.858634 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:33.858634 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:43:33.858831 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] iscsi session list stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:33.858831 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:33.858831 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:33.858831 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:33.858831 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:43:33.892935 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92, portal: 192.168.40.100,3260] Jul 05 03:43:33.892935 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92, portal: 192.168.40.100,3260] successful. Jul 05 03:43:33.892935 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:33.902568 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:33.913658 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] iscsiadm ('-m', 'session'): stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:33.913658 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:33.913658 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:33.913658 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:33.913658 np0000004562 cinder-backup[101413]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92 (non-flash) Jul 05 03:43:33.913658 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:43:33.913869 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] iscsi session list stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:33.913869 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:33.913869 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:33.913869 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:33.913869 np0000004562 cinder-backup[101413]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92 (non-flash) Jul 05 03:43:33.913869 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:43:33.914154 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.103s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:43:33.914299 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:43:33.915056 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] HCTL ('8', '-', '-', 0) found on session 157 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:43:33.915212 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Scanning host 8 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:43:33.925918 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Searching for a device in session 157 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:43:33.926088 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '98295ac8-1979-4056-8a5b-bb5d71f20e92', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:43:34.095615 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Create backup started, backup: 2c9b1956-fcc7-4588-af39-987d4c54fac3 volume: 04edf182-6b4b-4ca0-a438-23709fa3e558. Jul 05 03:43:34.100236 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T03:43:34Z,data_timestamp=2026-07-05T03:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='np0000004562',id=2c9b1956-fcc7-4588-af39-987d4c54fac3,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2),parent_id='8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2',project_id='9ebf67ca50e54c89bb8084c855cb1e32',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='e89d8ef0122f41c999bbb4d9fd9d8712',volume_id=04edf182-6b4b-4ca0-a438-23709fa3e558) Jul 05 03:43:34.151070 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_9ebf67ca50e54c89bb8084c855cb1e32 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:43:34.151294 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:43:34.151609 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:43:34.162818 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:43:34.182445 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:43:34.196163 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:43:34.196400 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:43:34.204240 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:43:34.205550 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe1a:265c', 'fe80::689e:ddff:fe47:c424', 'fe80::f816:3eff:feec:87ae', 'fe80::4871:a0ff:feb5:e1d', 'fe80::f816:3eff:fe6c:6eb0', 'fe80::2c3f:65ff:fe45:1d49', 'fe80::f816:3eff:fe92:c48f', 'fe80::80e7:33ff:fe1d:273b'] Jul 05 03:43:34.205725 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:43:34.205895 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:43:34.206176 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] <== get_connector_properties: return (54ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:43:34.710794 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:43:34.711258 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7fd18f92-8ebd-4d6c-ac63-8b46f456bbc5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7fd18f92-8ebd-4d6c-ac63-8b46f456bbc5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:43:34.711462 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:43:34.929539 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.127s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:43:34.929903 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] <== connect_volume: return (2128ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799150', 'path': '/dev/sdc'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:43:34.930142 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:43:34.938568 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.226s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:43:34.938987 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7fd18f92-8ebd-4d6c-ac63-8b46f456bbc5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7fd18f92-8ebd-4d6c-ac63-8b46f456bbc5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:43:34.951395 np0000004562 sudo[144513]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc Jul 05 03:43:34.952128 np0000004562 sudo[144513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:43:34.952752 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7fd18f92-8ebd-4d6c-ac63-8b46f456bbc5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:43:34.952986 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7fd18f92-8ebd-4d6c-ac63-8b46f456bbc5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:43:34.953253 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:43:34.965319 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:43:34.965319 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:34.975920 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7fd18f92-8ebd-4d6c-ac63-8b46f456bbc5] added Jul 05 03:43:34.975920 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:43:34.975920 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:43:34.975920 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:43:34.975920 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:43:34.975920 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:43:34.975920 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:34.976134 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:43:34.976673 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0233(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:43:34.976952 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:43:35.266893 np0000004562 sudo[144513]: pam_unix(sudo:session): session closed for user root Jul 05 03:43:35.268732 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc" returned: 0 in 0.338s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:43:35.307979 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:43:35.313687 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] _create_container started, container: volumebackups,backup: 529d0366-7166-4b7c-9e66-8903464a068a. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:43:35.339360 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] generate_object_name_prefix: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:43:35.343578 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] starting backup of volume: 98295ac8-1979-4056-8a5b-bb5d71f20e92, volume size: 1073741824, object names prefix volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:43:35.512776 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:35.760384 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:35.760492 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:35.872050 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:35.872264 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:35.977573 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-7fd18f92-8ebd-4d6c-ac63-8b46f456bbc5 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:43:35.988386 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:36.002141 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:36.015868 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] iscsiadm ('-m', 'session'): stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:36.015868 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:36.015868 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:36.015868 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:36.015868 np0000004562 cinder-backup[101413]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92 (non-flash) Jul 05 03:43:36.015868 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:43:36.016093 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] iscsi session list stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:36.016093 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:36.016093 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:36.016093 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:36.016093 np0000004562 cinder-backup[101413]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92 (non-flash) Jul 05 03:43:36.016093 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:43:36.052672 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7fd18f92-8ebd-4d6c-ac63-8b46f456bbc5, portal: 192.168.40.100,3260] Jul 05 03:43:36.052672 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7fd18f92-8ebd-4d6c-ac63-8b46f456bbc5, portal: 192.168.40.100,3260] successful. Jul 05 03:43:36.052672 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:36.067808 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:36.081409 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:36.085353 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] iscsiadm ('-m', 'session'): stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:36.085353 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:36.085353 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:36.085353 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:36.085353 np0000004562 cinder-backup[101413]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92 (non-flash) Jul 05 03:43:36.085353 np0000004562 cinder-backup[101413]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fd18f92-8ebd-4d6c-ac63-8b46f456bbc5 (non-flash) Jul 05 03:43:36.085353 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:43:36.085767 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] iscsi session list stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:36.085767 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:36.085767 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:36.085767 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:36.085767 np0000004562 cinder-backup[101413]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92 (non-flash) Jul 05 03:43:36.085767 np0000004562 cinder-backup[101413]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fd18f92-8ebd-4d6c-ac63-8b46f456bbc5 (non-flash) Jul 05 03:43:36.085767 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:43:36.086042 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7fd18f92-8ebd-4d6c-ac63-8b46f456bbc5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.133s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:43:36.086131 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:43:36.087109 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] HCTL ('9', '-', '-', 0) found on session 158 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:43:36.087296 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Scanning host 9 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:43:36.102809 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Searching for a device in session 158 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:43:36.103040 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7fd18f92-8ebd-4d6c-ac63-8b46f456bbc5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7fd18f92-8ebd-4d6c-ac63-8b46f456bbc5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:43:36.340267 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:36.340496 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:36.437646 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:36.437887 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:36.648360 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:36.885172 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:36.885338 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:36.986357 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:36.986901 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:37.105530 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.168s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:43:37.105810 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] <== connect_volume: return (2394ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799156', 'path': '/dev/sdd'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:43:37.106169 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:43:37.137849 np0000004562 sudo[144574]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd Jul 05 03:43:37.140367 np0000004562 sudo[144574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:43:37.210114 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:37.459394 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:37.459721 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:37.478235 np0000004562 sudo[144574]: pam_unix(sudo:session): session closed for user root Jul 05 03:43:37.479917 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd" returned: 0 in 0.374s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:43:37.499846 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] _read_sha256file started, container name: tempest-volumesbackupstest-backup-container-1257406501, sha256 filename: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2_sha256file. {{(pid=101413) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:333}} Jul 05 03:43:37.540633 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] _read_sha256file finished. {{(pid=101413) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:340}} Jul 05 03:43:37.552272 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] _create_container started, container: volumebackups,backup: 2c9b1956-fcc7-4588-af39-987d4c54fac3. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:43:37.583804 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:37.583804 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:37.612329 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] generate_object_name_prefix: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034337/az_nova_backup_2c9b1956-fcc7-4588-af39-987d4c54fac3 {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:43:37.620038 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] starting backup of volume: 04edf182-6b4b-4ca0-a438-23709fa3e558, volume size: 1073741824, object names prefix volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034337/az_nova_backup_2c9b1956-fcc7-4588-af39-987d4c54fac3, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:43:37.865869 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:38.130641 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:38.131132 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:38.246823 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:38.246823 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:38.507964 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:38.774071 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:38.774232 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:38.895798 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:38.896024 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:39.129625 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:39.392355 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:39.392736 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:39.511119 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:39.511345 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:39.769304 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:40.040058 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:40.040058 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:40.155898 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:40.156092 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:40.418025 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:40.676235 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:40.676372 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:40.785707 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:40.785865 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:41.097547 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:41.367283 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:41.367472 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:41.472073 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:41.472606 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:41.730397 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:41.985066 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:41.985323 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:42.086405 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:42.086676 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:42.287274 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:43:42.298467 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:43:42.298753 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:43:42.306075 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:43:42.306075 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:43:42.310624 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:43:42.310950 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034337/az_nova_backup_2c9b1956-fcc7-4588-af39-987d4c54fac3_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:43:42.382977 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:42.383729 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:43:42.384669 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] _write_metadata started, container name: volumebackups, metadata filename: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034337/az_nova_backup_2c9b1956-fcc7-4588-af39-987d4c54fac3_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:43:42.416517 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "2c9b1956-fcc7-4588-af39-987d4c54fac3",\n "backup_name": null,\n "created_at": "2026-07-05 03:43:34+00:00",\n "objects": [],\n "parent_id": "8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2",\n "version": "1.0.0",\n "volume_id": "04edf182-6b4b-4ca0-a438-23709fa3e558",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"04edf182-6b4b-4ca0-a438-23709fa3e558\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"e89d8ef0122f41c999bbb4d9fd9d8712\\", \\"project_id\\": \\"9ebf67ca50e54c89bb8084c855cb1e32\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"attached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:42:05.000000\\", \\"launched_at\\": \\"2026-07-05T03:42:06.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-645460743\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"in-use\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:42:05.000000\\", \\"updated_at\\": \\"2026-07-05T03:43:34.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:43:42.426253 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] backup 2c9b1956-fcc7-4588-af39-987d4c54fac3 finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:43:42.565508 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:43:42.587857 np0000004562 sudo[145126]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd Jul 05 03:43:42.588630 np0000004562 sudo[145126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:43:42.647168 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:42.647447 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:42.755385 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:42.755582 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:42.913730 np0000004562 sudo[145126]: pam_unix(sudo:session): session closed for user root Jul 05 03:43:42.915659 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd" returned: 0 in 0.350s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:43:42.916279 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7fd18f92-8ebd-4d6c-ac63-8b46f456bbc5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7fd18f92-8ebd-4d6c-ac63-8b46f456bbc5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799156', 'path': '/dev/sdd'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:43:42.916640 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:43:42.957978 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:43.240581 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:43.240731 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:43.347030 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:43.347194 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:43.554230 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:43.794352 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:43.794800 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:43.892090 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:43.892205 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:44.080099 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:44.178152 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.261s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:43:44.178678 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7fd18f92-8ebd-4d6c-ac63-8b46f456bbc5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7fd18f92-8ebd-4d6c-ac63-8b46f456bbc5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-7fd18f92-8ebd-4d6c-ac63-8b46f456bbc5 Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92 Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:43:44.190746 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:43:44.191885 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:43:44.191885 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:43:44.191885 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:43:44.191885 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fd18f92-8ebd-4d6c-ac63-8b46f456bbc5', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:43:44.217290 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] iscsiadm ('-m', 'session'): stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:44.217290 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:44.217290 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:44.217290 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:44.217290 np0000004562 cinder-backup[101413]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92 (non-flash) Jul 05 03:43:44.217290 np0000004562 cinder-backup[101413]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fd18f92-8ebd-4d6c-ac63-8b46f456bbc5 (non-flash) Jul 05 03:43:44.217290 np0000004562 cinder-backup[101413]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:43:44.217290 np0000004562 cinder-backup[101413]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:43:44.217290 np0000004562 cinder-backup[101413]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:43:44.217290 np0000004562 cinder-backup[101413]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:43:44.217290 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:43:44.217763 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] iscsi session list stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:44.217763 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:44.217763 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:44.217763 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:44.217763 np0000004562 cinder-backup[101413]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92 (non-flash) Jul 05 03:43:44.217763 np0000004562 cinder-backup[101413]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fd18f92-8ebd-4d6c-ac63-8b46f456bbc5 (non-flash) Jul 05 03:43:44.217763 np0000004562 cinder-backup[101413]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:43:44.217763 np0000004562 cinder-backup[101413]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:43:44.217763 np0000004562 cinder-backup[101413]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:43:44.217763 np0000004562 cinder-backup[101413]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:43:44.217763 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:43:44.217763 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f', '149'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f', '150'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558', '152'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92', '157'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fd18f92-8ebd-4d6c-ac63-8b46f456bbc5', '158'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09', '159'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09', '160'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf', '161'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf', '162')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:43:44.217763 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7fd18f92-8ebd-4d6c-ac63-8b46f456bbc5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fd18f92-8ebd-4d6c-ac63-8b46f456bbc5', '158')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:43:44.218868 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Resulting device map defaultdict(. at 0x72a4705c31a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fd18f92-8ebd-4d6c-ac63-8b46f456bbc5'): ({'sdd'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:43:44.219069 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Removing single pathed devices sdd {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:43:44.229259 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Flushing IO for device /dev/sdd {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:43:44.236928 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:43:44.301136 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Checking to see if SCSI volumes sdd have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:43:44.301350 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] SCSI volumes sdd have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:43:44.302554 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Checking to see if device paths {'sdd'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:43:44.313144 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Device paths {'sdd'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:43:44.313331 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fd18f92-8ebd-4d6c-ac63-8b46f456bbc5')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:43:44.324730 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:44.334164 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:44.334333 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:44.353728 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 158, target: iqn.2023-03.storpool.com:os--volume-7fd18f92-8ebd-4d6c-ac63-8b46f456bbc5, portal: 192.168.40.100,3260] Jul 05 03:43:44.353728 np0000004562 cinder-backup[101413]: Logout of [sid: 158, target: iqn.2023-03.storpool.com:os--volume-7fd18f92-8ebd-4d6c-ac63-8b46f456bbc5, portal: 192.168.40.100,3260] successful. Jul 05 03:43:44.353728 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:44.391542 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:44.391542 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.213s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:43:44.391542 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] <== disconnect_volume: return (1474ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:43:44.456079 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:44.456237 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:44.836147 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:45.098365 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:45.098484 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:45.203107 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:45.203244 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:45.430382 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:45.451672 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-d5a95a14-7400-4b0a-8219-79d0032435ea tempest-VolumesBackupsTest-551128076 None] Create backup finished. backup: 2c9b1956-fcc7-4588-af39-987d4c54fac3. Jul 05 03:43:45.541494 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-4d0989a1-aaa8-4b40-a087-f6066db3e30f tempest-VolumesBackupsTest-551128076 None] Delete backup started, backup: 2c9b1956-fcc7-4588-af39-987d4c54fac3. Jul 05 03:43:45.548594 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-4d0989a1-aaa8-4b40-a087-f6066db3e30f tempest-VolumesBackupsTest-551128076 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_9ebf67ca50e54c89bb8084c855cb1e32 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:43:45.548985 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-4d0989a1-aaa8-4b40-a087-f6066db3e30f tempest-VolumesBackupsTest-551128076 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:43:45.549220 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d0989a1-aaa8-4b40-a087-f6066db3e30f tempest-VolumesBackupsTest-551128076 None] delete started, backup: 2c9b1956-fcc7-4588-af39-987d4c54fac3, container: volumebackups, prefix: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034337/az_nova_backup_2c9b1956-fcc7-4588-af39-987d4c54fac3. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:43:45.598459 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d0989a1-aaa8-4b40-a087-f6066db3e30f tempest-VolumesBackupsTest-551128076 None] generated object list: ['volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034337/az_nova_backup_2c9b1956-fcc7-4588-af39-987d4c54fac3_metadata', 'volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034337/az_nova_backup_2c9b1956-fcc7-4588-af39-987d4c54fac3_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:43:45.623793 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d0989a1-aaa8-4b40-a087-f6066db3e30f tempest-VolumesBackupsTest-551128076 None] deleted object: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034337/az_nova_backup_2c9b1956-fcc7-4588-af39-987d4c54fac3_metadata in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:45.644671 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d0989a1-aaa8-4b40-a087-f6066db3e30f tempest-VolumesBackupsTest-551128076 None] deleted object: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034337/az_nova_backup_2c9b1956-fcc7-4588-af39-987d4c54fac3_sha256file in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:45.644909 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4d0989a1-aaa8-4b40-a087-f6066db3e30f tempest-VolumesBackupsTest-551128076 None] delete 2c9b1956-fcc7-4588-af39-987d4c54fac3 finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:43:45.681671 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-4d0989a1-aaa8-4b40-a087-f6066db3e30f tempest-VolumesBackupsTest-551128076 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:43:45.695031 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-4d0989a1-aaa8-4b40-a087-f6066db3e30f tempest-VolumesBackupsTest-551128076 None] Created reservations ['7a5407b2-3e7c-42ca-a75f-43727d0c7da6', '2a7aed56-2a89-4eb7-a722-989ef7a87476'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:43:45.696656 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:45.696804 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:45.721642 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-4d0989a1-aaa8-4b40-a087-f6066db3e30f tempest-VolumesBackupsTest-551128076 None] Delete backup finished, backup 2c9b1956-fcc7-4588-af39-987d4c54fac3 deleted. Jul 05 03:43:45.799863 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:45.800078 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:46.005612 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:46.263462 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:46.263616 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:46.374299 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:46.374459 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:46.579932 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:46.699172 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Create backup started, backup: 76125475-1d9b-479f-92f9-40237b418af6 volume: 04edf182-6b4b-4ca0-a438-23709fa3e558. Jul 05 03:43:46.703514 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-353991033',created_at=2026-07-05T03:43:46Z,data_timestamp=2026-07-05T03:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-965962778',encryption_key_id=None,fail_reason=None,host='np0000004562',id=76125475-1d9b-479f-92f9-40237b418af6,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2),parent_id='8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2',project_id='9ebf67ca50e54c89bb8084c855cb1e32',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='e89d8ef0122f41c999bbb4d9fd9d8712',volume_id=04edf182-6b4b-4ca0-a438-23709fa3e558) Jul 05 03:43:46.765068 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_9ebf67ca50e54c89bb8084c855cb1e32 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:43:46.765068 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:43:46.765068 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:43:46.775823 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:43:46.796033 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:43:46.813734 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:43:46.814437 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:43:46.824730 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:43:46.824730 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe1a:265c', 'fe80::689e:ddff:fe47:c424', 'fe80::f816:3eff:feec:87ae', 'fe80::4871:a0ff:feb5:e1d', 'fe80::f816:3eff:fe6c:6eb0', 'fe80::2c3f:65ff:fe45:1d49', 'fe80::f816:3eff:fe92:c48f', 'fe80::80e7:33ff:fe1d:273b', 'fe80::f816:3eff:feec:8698', 'fe80::e075:aff:fed9:9a2e', 'fe80::f816:3eff:fe1e:6f4f', 'fe80::e477:baff:fee9:cab5'] Jul 05 03:43:46.824730 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:43:46.824730 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:43:46.824730 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] <== get_connector_properties: return (59ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:43:46.839973 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:46.839973 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:46.952772 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:46.952772 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:47.005377 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:43:47.190063 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:47.330429 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:43:47.330839 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4691a9c9-68f7-4e60-8b28-019d5cc986a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4691a9c9-68f7-4e60-8b28-019d5cc986a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:43:47.330986 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:43:47.331406 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:43:47.331611 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4691a9c9-68f7-4e60-8b28-019d5cc986a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4691a9c9-68f7-4e60-8b28-019d5cc986a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:43:47.342042 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4691a9c9-68f7-4e60-8b28-019d5cc986a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:43:47.342404 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4691a9c9-68f7-4e60-8b28-019d5cc986a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:43:47.342623 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:43:47.353104 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:43:47.353104 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:47.362594 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4691a9c9-68f7-4e60-8b28-019d5cc986a7] added Jul 05 03:43:47.362594 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:43:47.362594 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:43:47.362594 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:43:47.362594 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:43:47.362594 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:43:47.362594 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:47.362834 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:43:47.363168 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0205(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:43:47.363340 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:43:47.433907 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:47.434047 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:47.531988 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:47.532157 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:47.622406 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:47.747373 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:47.747603 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:47.834917 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:47.835423 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:47.847883 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:43:47.857521 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:43:47.857521 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:43:47.861789 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:43:47.861941 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:43:47.866550 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:43:47.866843 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:43:47.944084 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:43:47.944994 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] _write_metadata started, container name: volumebackups, metadata filename: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:43:47.970106 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "529d0366-7166-4b7c-9e66-8903464a068a",\n "backup_name": null,\n "created_at": "2026-07-05 03:43:32+00:00",\n "objects": [\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "98295ac8-1979-4056-8a5b-bb5d71f20e92",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"98295ac8-1979-4056-8a5b-bb5d71f20e92\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"b7fc80cd98414492aad9972b4676fdb6\\", \\"project_id\\": \\"4891f452f0954ca2ab42df311c6d7f91\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:43:07.000000\\", \\"launched_at\\": \\"2026-07-05T03:43:08.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1042948977\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:43:07.000000\\", \\"updated_at\\": \\"2026-07-05T03:43:32.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:43:47.974728 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] backup 529d0366-7166-4b7c-9e66-8903464a068a finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:43:48.115155 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:43:48.133347 np0000004562 sudo[145260]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc Jul 05 03:43:48.133980 np0000004562 sudo[145260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:43:48.365227 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-4691a9c9-68f7-4e60-8b28-019d5cc986a7 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:43:48.375645 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:48.385698 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:48.399826 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('-m', 'session'): stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:48.399826 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:48.399826 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:48.399826 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:48.399826 np0000004562 cinder-backup[101413]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92 (non-flash) Jul 05 03:43:48.399826 np0000004562 cinder-backup[101413]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:43:48.399826 np0000004562 cinder-backup[101413]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:43:48.399826 np0000004562 cinder-backup[101413]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:43:48.399826 np0000004562 cinder-backup[101413]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:43:48.399826 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:43:48.400173 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] iscsi session list stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:48.400173 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:48.400173 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:48.400173 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:48.400173 np0000004562 cinder-backup[101413]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92 (non-flash) Jul 05 03:43:48.400173 np0000004562 cinder-backup[101413]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:43:48.400173 np0000004562 cinder-backup[101413]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:43:48.400173 np0000004562 cinder-backup[101413]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:43:48.400173 np0000004562 cinder-backup[101413]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:43:48.400173 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:43:48.438276 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4691a9c9-68f7-4e60-8b28-019d5cc986a7, portal: 192.168.40.100,3260] Jul 05 03:43:48.438276 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4691a9c9-68f7-4e60-8b28-019d5cc986a7, portal: 192.168.40.100,3260] successful. Jul 05 03:43:48.438276 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:48.447876 np0000004562 sudo[145260]: pam_unix(sudo:session): session closed for user root Jul 05 03:43:48.448369 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:48.449395 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc" returned: 0 in 0.334s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:43:48.449902 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '98295ac8-1979-4056-8a5b-bb5d71f20e92', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799150', 'path': '/dev/sdc'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:43:48.450064 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:43:48.464047 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('-m', 'session'): stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:48.464047 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:48.464047 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:48.464047 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:48.464047 np0000004562 cinder-backup[101413]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92 (non-flash) Jul 05 03:43:48.464047 np0000004562 cinder-backup[101413]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:43:48.464047 np0000004562 cinder-backup[101413]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:43:48.464047 np0000004562 cinder-backup[101413]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:43:48.464047 np0000004562 cinder-backup[101413]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:43:48.464047 np0000004562 cinder-backup[101413]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4691a9c9-68f7-4e60-8b28-019d5cc986a7 (non-flash) Jul 05 03:43:48.464047 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:43:48.464488 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] iscsi session list stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:48.464488 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:48.464488 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:48.464488 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:48.464488 np0000004562 cinder-backup[101413]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92 (non-flash) Jul 05 03:43:48.464488 np0000004562 cinder-backup[101413]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:43:48.464488 np0000004562 cinder-backup[101413]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:43:48.464488 np0000004562 cinder-backup[101413]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:43:48.464488 np0000004562 cinder-backup[101413]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:43:48.464488 np0000004562 cinder-backup[101413]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4691a9c9-68f7-4e60-8b28-019d5cc986a7 (non-flash) Jul 05 03:43:48.464488 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:43:48.464791 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4691a9c9-68f7-4e60-8b28-019d5cc986a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.122s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:43:48.464865 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:43:48.465858 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] HCTL ('9', '-', '-', 0) found on session 163 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:43:48.465990 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Scanning host 9 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:43:48.478459 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Searching for a device in session 163 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:43:48.478459 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4691a9c9-68f7-4e60-8b28-019d5cc986a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4691a9c9-68f7-4e60-8b28-019d5cc986a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:43:49.482062 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.150s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:43:49.482507 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] <== connect_volume: return (2151ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799158', 'path': '/dev/sdd'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:43:49.482902 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:43:49.489272 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.038s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:43:49.490140 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '98295ac8-1979-4056-8a5b-bb5d71f20e92', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-4691a9c9-68f7-4e60-8b28-019d5cc986a7 Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92 Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:43:49.501701 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:43:49.502507 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:43:49.502507 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:43:49.502507 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:43:49.502507 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:43:49.502773 np0000004562 sudo[145319]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd Jul 05 03:43:49.503558 np0000004562 sudo[145319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:43:49.526578 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] iscsiadm ('-m', 'session'): stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:49.526578 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:49.526578 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:49.526578 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:49.526578 np0000004562 cinder-backup[101413]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92 (non-flash) Jul 05 03:43:49.526578 np0000004562 cinder-backup[101413]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:43:49.526578 np0000004562 cinder-backup[101413]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:43:49.526578 np0000004562 cinder-backup[101413]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:43:49.526578 np0000004562 cinder-backup[101413]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:43:49.526578 np0000004562 cinder-backup[101413]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4691a9c9-68f7-4e60-8b28-019d5cc986a7 (non-flash) Jul 05 03:43:49.526578 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:43:49.526960 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] iscsi session list stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:49.526960 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:49.526960 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:49.526960 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:49.526960 np0000004562 cinder-backup[101413]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92 (non-flash) Jul 05 03:43:49.526960 np0000004562 cinder-backup[101413]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:43:49.526960 np0000004562 cinder-backup[101413]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:43:49.526960 np0000004562 cinder-backup[101413]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:43:49.526960 np0000004562 cinder-backup[101413]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:43:49.526960 np0000004562 cinder-backup[101413]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4691a9c9-68f7-4e60-8b28-019d5cc986a7 (non-flash) Jul 05 03:43:49.526960 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:43:49.527180 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f', '149'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f', '150'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558', '152'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92', '157'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09', '159'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09', '160'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf', '161'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf', '162'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4691a9c9-68f7-4e60-8b28-019d5cc986a7', '163')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:43:49.527255 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92', '157')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:43:49.528724 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Resulting device map defaultdict(. at 0x72a470324900>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92'): ({'sdc'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:43:49.529107 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Removing single pathed devices sdc {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:43:49.540597 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Flushing IO for device /dev/sdc {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:43:49.547738 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:43:49.602269 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Checking to see if SCSI volumes sdc have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:43:49.602488 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] SCSI volumes sdc have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:43:49.604359 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Checking to see if device paths {'sdc'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:43:49.615404 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Device paths {'sdc'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:43:49.615759 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:43:49.627102 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:49.663328 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 157, target: iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92, portal: 192.168.40.100,3260] Jul 05 03:43:49.663328 np0000004562 cinder-backup[101413]: Logout of [sid: 157, target: iqn.2023-03.storpool.com:os--volume-98295ac8-1979-4056-8a5b-bb5d71f20e92, portal: 192.168.40.100,3260] successful. Jul 05 03:43:49.663328 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:49.679455 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:49.679822 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.192s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:43:49.679978 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] <== disconnect_volume: return (1230ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:43:49.800501 np0000004562 sudo[145319]: pam_unix(sudo:session): session closed for user root Jul 05 03:43:49.802356 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd" returned: 0 in 0.319s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:43:49.807793 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] _read_sha256file started, container name: tempest-volumesbackupstest-backup-container-1257406501, sha256 filename: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2_sha256file. {{(pid=101413) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:333}} Jul 05 03:43:49.845636 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] _read_sha256file finished. {{(pid=101413) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:340}} Jul 05 03:43:49.852193 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] _create_container started, container: tempest-volumesbackupstest-backup-container-353991033,backup: 76125475-1d9b-479f-92f9-40237b418af6. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:43:49.901958 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] generate_object_name_prefix: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034349/az_nova_backup_76125475-1d9b-479f-92f9-40237b418af6 {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:43:49.908975 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] starting backup of volume: 04edf182-6b4b-4ca0-a438-23709fa3e558, volume size: 1073741824, object names prefix volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034349/az_nova_backup_76125475-1d9b-479f-92f9-40237b418af6, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:43:50.702778 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-6949ffeb-c17f-4ccc-aba6-db0dbc1ca48d tempest-ProjectAdminTests33-657181126 None] Create backup finished. backup: 529d0366-7166-4b7c-9e66-8903464a068a. Jul 05 03:43:51.689365 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-87e6c7e8-cc97-45ac-8c29-671a72e2b343 tempest-ProjectAdminTests33-657181126 None] Delete backup started, backup: 529d0366-7166-4b7c-9e66-8903464a068a. Jul 05 03:43:51.695497 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-87e6c7e8-cc97-45ac-8c29-671a72e2b343 tempest-ProjectAdminTests33-657181126 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_4891f452f0954ca2ab42df311c6d7f91 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:43:51.695837 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-87e6c7e8-cc97-45ac-8c29-671a72e2b343 tempest-ProjectAdminTests33-657181126 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:43:51.697822 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-87e6c7e8-cc97-45ac-8c29-671a72e2b343 tempest-ProjectAdminTests33-657181126 None] delete started, backup: 529d0366-7166-4b7c-9e66-8903464a068a, container: volumebackups, prefix: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:43:51.738942 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-87e6c7e8-cc97-45ac-8c29-671a72e2b343 tempest-ProjectAdminTests33-657181126 None] generated object list: ['volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00001', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00002', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00003', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00004', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00005', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00006', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00007', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00008', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00009', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00010', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00011', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00012', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00013', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00014', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00015', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00016', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00017', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00018', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00019', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00020', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00021', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a_metadata', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:43:51.764266 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-87e6c7e8-cc97-45ac-8c29-671a72e2b343 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00001 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:51.804044 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-87e6c7e8-cc97-45ac-8c29-671a72e2b343 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00002 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:51.812867 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:43:51.825748 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-87e6c7e8-cc97-45ac-8c29-671a72e2b343 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00003 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:51.843423 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-87e6c7e8-cc97-45ac-8c29-671a72e2b343 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00004 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:51.867699 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-87e6c7e8-cc97-45ac-8c29-671a72e2b343 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00005 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:51.894988 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-87e6c7e8-cc97-45ac-8c29-671a72e2b343 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00006 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:51.917034 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-87e6c7e8-cc97-45ac-8c29-671a72e2b343 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00007 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:51.940550 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-87e6c7e8-cc97-45ac-8c29-671a72e2b343 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00008 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:51.961840 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-87e6c7e8-cc97-45ac-8c29-671a72e2b343 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00009 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:51.984867 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-87e6c7e8-cc97-45ac-8c29-671a72e2b343 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00010 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:52.012229 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-87e6c7e8-cc97-45ac-8c29-671a72e2b343 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00011 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:52.037601 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-87e6c7e8-cc97-45ac-8c29-671a72e2b343 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00012 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:52.057608 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-87e6c7e8-cc97-45ac-8c29-671a72e2b343 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00013 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:52.081392 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-87e6c7e8-cc97-45ac-8c29-671a72e2b343 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00014 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:52.102122 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-87e6c7e8-cc97-45ac-8c29-671a72e2b343 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00015 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:52.126650 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-87e6c7e8-cc97-45ac-8c29-671a72e2b343 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00016 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:52.146319 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-87e6c7e8-cc97-45ac-8c29-671a72e2b343 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00017 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:52.168037 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-87e6c7e8-cc97-45ac-8c29-671a72e2b343 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00018 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:52.193844 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-87e6c7e8-cc97-45ac-8c29-671a72e2b343 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00019 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:52.215898 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-87e6c7e8-cc97-45ac-8c29-671a72e2b343 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00020 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:52.236703 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-87e6c7e8-cc97-45ac-8c29-671a72e2b343 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a-00021 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:52.259868 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-87e6c7e8-cc97-45ac-8c29-671a72e2b343 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a_metadata in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:52.283780 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-87e6c7e8-cc97-45ac-8c29-671a72e2b343 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034335/az_nova_backup_529d0366-7166-4b7c-9e66-8903464a068a_sha256file in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:52.284042 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-87e6c7e8-cc97-45ac-8c29-671a72e2b343 tempest-ProjectAdminTests33-657181126 None] delete 529d0366-7166-4b7c-9e66-8903464a068a finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:43:52.302781 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-87e6c7e8-cc97-45ac-8c29-671a72e2b343 tempest-ProjectAdminTests33-657181126 None] Created reservations ['9acc79a6-9033-479b-8a06-11cc0e0a9b7a', '5599259c-a628-4a39-a83f-7c143617dcd3'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:43:52.321207 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-87e6c7e8-cc97-45ac-8c29-671a72e2b343 tempest-ProjectAdminTests33-657181126 None] Delete backup finished, backup 529d0366-7166-4b7c-9e66-8903464a068a deleted. Jul 05 03:43:53.061337 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Create backup started, backup: f90df3cc-e5e4-486f-ab99-6bd61fc1db4d volume: 516c9cf6-85c2-49e9-b496-3b1c2a541532. Jul 05 03:43:53.067534 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T03:43:53Z,data_timestamp=2026-07-05T03:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-1117758538',encryption_key_id=None,fail_reason=None,host='np0000004562',id=f90df3cc-e5e4-486f-ab99-6bd61fc1db4d,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='4891f452f0954ca2ab42df311c6d7f91',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='b7fc80cd98414492aad9972b4676fdb6',volume_id=516c9cf6-85c2-49e9-b496-3b1c2a541532) Jul 05 03:43:53.096151 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_4891f452f0954ca2ab42df311c6d7f91 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:43:53.096469 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:43:53.096860 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:43:53.108991 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:43:53.137197 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:43:53.158568 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:43:53.159702 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:43:53.168841 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:43:53.170470 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe1a:265c', 'fe80::689e:ddff:fe47:c424', 'fe80::f816:3eff:feec:87ae', 'fe80::4871:a0ff:feb5:e1d', 'fe80::f816:3eff:fe6c:6eb0', 'fe80::2c3f:65ff:fe45:1d49', 'fe80::f816:3eff:fe92:c48f', 'fe80::80e7:33ff:fe1d:273b', 'fe80::f816:3eff:feec:8698', 'fe80::e075:aff:fed9:9a2e', 'fe80::f816:3eff:fe1e:6f4f', 'fe80::e477:baff:fee9:cab5'] Jul 05 03:43:53.170687 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:43:53.170859 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:43:53.171217 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] <== get_connector_properties: return (74ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:43:53.226306 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:43:53.675125 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:43:53.675562 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-516c9cf6-85c2-49e9-b496-3b1c2a541532', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '516c9cf6-85c2-49e9-b496-3b1c2a541532', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:43:53.675758 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:43:53.676204 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:43:53.676411 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-516c9cf6-85c2-49e9-b496-3b1c2a541532', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '516c9cf6-85c2-49e9-b496-3b1c2a541532', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:43:53.688482 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-516c9cf6-85c2-49e9-b496-3b1c2a541532" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:43:53.689035 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-516c9cf6-85c2-49e9-b496-3b1c2a541532" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:43:53.689232 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:43:53.700670 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:43:53.700670 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:53.712212 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-516c9cf6-85c2-49e9-b496-3b1c2a541532] added Jul 05 03:43:53.712212 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:43:53.712212 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:43:53.712212 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:43:53.712212 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:43:53.712212 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:43:53.712212 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:53.712495 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:43:53.712886 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0235(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:43:53.713100 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:43:53.884840 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:43:53.890430 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:43:53.890615 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:43:53.894096 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:43:53.894213 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:43:53.897076 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:43:53.897281 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-353991033, sha256file filename: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034349/az_nova_backup_76125475-1d9b-479f-92f9-40237b418af6_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:43:53.966060 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:43:53.966722 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-353991033, metadata filename: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034349/az_nova_backup_76125475-1d9b-479f-92f9-40237b418af6_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:43:53.987610 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "76125475-1d9b-479f-92f9-40237b418af6",\n "backup_name": "tempest-VolumesBackupsTest-Backup-965962778",\n "created_at": "2026-07-05 03:43:47+00:00",\n "objects": [],\n "parent_id": "8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2",\n "version": "1.0.0",\n "volume_id": "04edf182-6b4b-4ca0-a438-23709fa3e558",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"04edf182-6b4b-4ca0-a438-23709fa3e558\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"e89d8ef0122f41c999bbb4d9fd9d8712\\", \\"project_id\\": \\"9ebf67ca50e54c89bb8084c855cb1e32\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"attached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:42:05.000000\\", \\"launched_at\\": \\"2026-07-05T03:42:06.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-645460743\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"in-use\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:42:05.000000\\", \\"updated_at\\": \\"2026-07-05T03:43:47.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:43:53.993863 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] backup 76125475-1d9b-479f-92f9-40237b418af6 finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:43:54.116140 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:43:54.137783 np0000004562 sudo[145399]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd Jul 05 03:43:54.138628 np0000004562 sudo[145399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:43:54.442773 np0000004562 sudo[145399]: pam_unix(sudo:session): session closed for user root Jul 05 03:43:54.444678 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd" returned: 0 in 0.328s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:43:54.445273 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4691a9c9-68f7-4e60-8b28-019d5cc986a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4691a9c9-68f7-4e60-8b28-019d5cc986a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799158', 'path': '/dev/sdd'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:43:54.445497 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:43:54.715136 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-516c9cf6-85c2-49e9-b496-3b1c2a541532 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:43:54.727011 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:54.739915 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:54.758666 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('-m', 'session'): stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:54.758666 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:54.758666 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:54.758666 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:54.758666 np0000004562 cinder-backup[101413]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:43:54.758666 np0000004562 cinder-backup[101413]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:43:54.758666 np0000004562 cinder-backup[101413]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:43:54.758666 np0000004562 cinder-backup[101413]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:43:54.758666 np0000004562 cinder-backup[101413]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4691a9c9-68f7-4e60-8b28-019d5cc986a7 (non-flash) Jul 05 03:43:54.758666 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:43:54.759413 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] iscsi session list stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:54.759413 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:54.759413 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:54.759413 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:54.759413 np0000004562 cinder-backup[101413]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:43:54.759413 np0000004562 cinder-backup[101413]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:43:54.759413 np0000004562 cinder-backup[101413]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:43:54.759413 np0000004562 cinder-backup[101413]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:43:54.759413 np0000004562 cinder-backup[101413]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4691a9c9-68f7-4e60-8b28-019d5cc986a7 (non-flash) Jul 05 03:43:54.759413 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:43:54.806530 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-516c9cf6-85c2-49e9-b496-3b1c2a541532, portal: 192.168.40.100,3260] Jul 05 03:43:54.806530 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-516c9cf6-85c2-49e9-b496-3b1c2a541532, portal: 192.168.40.100,3260] successful. Jul 05 03:43:54.806530 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:54.820835 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:54.840960 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('-m', 'session'): stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:54.840960 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:54.840960 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:54.840960 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:54.840960 np0000004562 cinder-backup[101413]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:43:54.840960 np0000004562 cinder-backup[101413]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:43:54.840960 np0000004562 cinder-backup[101413]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:43:54.840960 np0000004562 cinder-backup[101413]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:43:54.840960 np0000004562 cinder-backup[101413]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4691a9c9-68f7-4e60-8b28-019d5cc986a7 (non-flash) Jul 05 03:43:54.840960 np0000004562 cinder-backup[101413]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-516c9cf6-85c2-49e9-b496-3b1c2a541532 (non-flash) Jul 05 03:43:54.840960 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:43:54.841308 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] iscsi session list stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:54.841308 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:54.841308 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:54.841308 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:54.841308 np0000004562 cinder-backup[101413]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:43:54.841308 np0000004562 cinder-backup[101413]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:43:54.841308 np0000004562 cinder-backup[101413]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:43:54.841308 np0000004562 cinder-backup[101413]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:43:54.841308 np0000004562 cinder-backup[101413]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4691a9c9-68f7-4e60-8b28-019d5cc986a7 (non-flash) Jul 05 03:43:54.841308 np0000004562 cinder-backup[101413]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-516c9cf6-85c2-49e9-b496-3b1c2a541532 (non-flash) Jul 05 03:43:54.841308 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:43:54.841689 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-516c9cf6-85c2-49e9-b496-3b1c2a541532" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:43:54.841895 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:43:54.843298 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] HCTL ('8', '-', '-', 0) found on session 164 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:43:54.843504 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Scanning host 8 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:43:54.855905 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Searching for a device in session 164 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:43:54.855905 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-516c9cf6-85c2-49e9-b496-3b1c2a541532', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '516c9cf6-85c2-49e9-b496-3b1c2a541532', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:43:55.859267 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.183s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:43:55.859774 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] <== connect_volume: return (2183ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799159', 'path': '/dev/sdc'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:43:55.860480 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:43:55.869705 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.423s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:43:55.870992 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4691a9c9-68f7-4e60-8b28-019d5cc986a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4691a9c9-68f7-4e60-8b28-019d5cc986a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:43:55.879427 np0000004562 sudo[145485]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc Jul 05 03:43:55.880046 np0000004562 sudo[145485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-516c9cf6-85c2-49e9-b496-3b1c2a541532 Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-4691a9c9-68f7-4e60-8b28-019d5cc986a7 Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:43:55.884568 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:43:55.885530 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:43:55.885530 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:43:55.885530 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:43:55.885530 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4691a9c9-68f7-4e60-8b28-019d5cc986a7', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:43:55.911815 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('-m', 'session'): stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:55.911815 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:55.911815 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:55.911815 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:55.911815 np0000004562 cinder-backup[101413]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:43:55.911815 np0000004562 cinder-backup[101413]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:43:55.911815 np0000004562 cinder-backup[101413]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:43:55.911815 np0000004562 cinder-backup[101413]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:43:55.911815 np0000004562 cinder-backup[101413]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4691a9c9-68f7-4e60-8b28-019d5cc986a7 (non-flash) Jul 05 03:43:55.911815 np0000004562 cinder-backup[101413]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-516c9cf6-85c2-49e9-b496-3b1c2a541532 (non-flash) Jul 05 03:43:55.911815 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:43:55.912247 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] iscsi session list stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:55.912247 np0000004562 cinder-backup[101413]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:43:55.912247 np0000004562 cinder-backup[101413]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:55.912247 np0000004562 cinder-backup[101413]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558 (non-flash) Jul 05 03:43:55.912247 np0000004562 cinder-backup[101413]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:43:55.912247 np0000004562 cinder-backup[101413]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:43:55.912247 np0000004562 cinder-backup[101413]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:43:55.912247 np0000004562 cinder-backup[101413]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:43:55.912247 np0000004562 cinder-backup[101413]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4691a9c9-68f7-4e60-8b28-019d5cc986a7 (non-flash) Jul 05 03:43:55.912247 np0000004562 cinder-backup[101413]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-516c9cf6-85c2-49e9-b496-3b1c2a541532 (non-flash) Jul 05 03:43:55.912247 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:43:55.912247 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f', '149'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f', '150'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04edf182-6b4b-4ca0-a438-23709fa3e558', '152'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09', '159'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09', '160'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf', '161'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf', '162'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4691a9c9-68f7-4e60-8b28-019d5cc986a7', '163'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-516c9cf6-85c2-49e9-b496-3b1c2a541532', '164')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:43:55.912628 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4691a9c9-68f7-4e60-8b28-019d5cc986a7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4691a9c9-68f7-4e60-8b28-019d5cc986a7', '163')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:43:55.913642 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Resulting device map defaultdict(. at 0x72a470243600>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4691a9c9-68f7-4e60-8b28-019d5cc986a7'): ({'sdd'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:43:55.913896 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Removing single pathed devices sdd {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:43:55.926675 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Flushing IO for device /dev/sdd {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:43:55.936655 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:43:55.995257 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Checking to see if SCSI volumes sdd have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:43:55.995493 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] SCSI volumes sdd have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:43:55.996862 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Checking to see if device paths {'sdd'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:43:56.011039 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Device paths {'sdd'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:43:56.011289 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4691a9c9-68f7-4e60-8b28-019d5cc986a7')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:43:56.024325 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:56.054911 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 163, target: iqn.2023-03.storpool.com:os--volume-4691a9c9-68f7-4e60-8b28-019d5cc986a7, portal: 192.168.40.100,3260] Jul 05 03:43:56.054911 np0000004562 cinder-backup[101413]: Logout of [sid: 163, target: iqn.2023-03.storpool.com:os--volume-4691a9c9-68f7-4e60-8b28-019d5cc986a7, portal: 192.168.40.100,3260] successful. Jul 05 03:43:56.054911 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:56.073316 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:43:56.073603 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.205s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:43:56.073773 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] <== disconnect_volume: return (1628ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:43:56.194343 np0000004562 sudo[145485]: pam_unix(sudo:session): session closed for user root Jul 05 03:43:56.196011 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc" returned: 0 in 0.336s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:43:56.203891 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] _create_container started, container: volumebackups,backup: f90df3cc-e5e4-486f-ab99-6bd61fc1db4d. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:43:56.235192 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] generate_object_name_prefix: volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:43:56.241144 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] starting backup of volume: 516c9cf6-85c2-49e9-b496-3b1c2a541532, volume size: 1073741824, object names prefix volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:43:56.449041 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:56.708761 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:56.708917 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:56.836350 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:56.836559 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:57.024908 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:57.135764 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-8850fa1c-8213-411d-8620-96195bb93045 tempest-VolumesBackupsTest-551128076 None] Create backup finished. backup: 76125475-1d9b-479f-92f9-40237b418af6. Jul 05 03:43:57.274385 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:57.274548 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:57.374086 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:57.374217 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:57.549976 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:57.800524 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:57.800810 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:57.919353 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:57.920465 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:58.002798 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-9d1d3aa4-8ade-4741-bd65-9d294ffb3af0 tempest-VolumesBackupsTest-551128076 None] Delete backup started, backup: 76125475-1d9b-479f-92f9-40237b418af6. Jul 05 03:43:58.014017 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-9d1d3aa4-8ade-4741-bd65-9d294ffb3af0 tempest-VolumesBackupsTest-551128076 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_9ebf67ca50e54c89bb8084c855cb1e32 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:43:58.015856 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-9d1d3aa4-8ade-4741-bd65-9d294ffb3af0 tempest-VolumesBackupsTest-551128076 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:43:58.016776 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9d1d3aa4-8ade-4741-bd65-9d294ffb3af0 tempest-VolumesBackupsTest-551128076 None] delete started, backup: 76125475-1d9b-479f-92f9-40237b418af6, container: tempest-volumesbackupstest-backup-container-353991033, prefix: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034349/az_nova_backup_76125475-1d9b-479f-92f9-40237b418af6. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:43:58.085585 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9d1d3aa4-8ade-4741-bd65-9d294ffb3af0 tempest-VolumesBackupsTest-551128076 None] generated object list: ['volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034349/az_nova_backup_76125475-1d9b-479f-92f9-40237b418af6_metadata', 'volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034349/az_nova_backup_76125475-1d9b-479f-92f9-40237b418af6_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:43:58.115223 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9d1d3aa4-8ade-4741-bd65-9d294ffb3af0 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034349/az_nova_backup_76125475-1d9b-479f-92f9-40237b418af6_metadata in container: tempest-volumesbackupstest-backup-container-353991033. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:58.141372 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9d1d3aa4-8ade-4741-bd65-9d294ffb3af0 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034349/az_nova_backup_76125475-1d9b-479f-92f9-40237b418af6_sha256file in container: tempest-volumesbackupstest-backup-container-353991033. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:58.141685 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-9d1d3aa4-8ade-4741-bd65-9d294ffb3af0 tempest-VolumesBackupsTest-551128076 None] delete 76125475-1d9b-479f-92f9-40237b418af6 finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:43:58.197083 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:58.203813 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-9d1d3aa4-8ade-4741-bd65-9d294ffb3af0 tempest-VolumesBackupsTest-551128076 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:43:58.221777 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-9d1d3aa4-8ade-4741-bd65-9d294ffb3af0 tempest-VolumesBackupsTest-551128076 None] Created reservations ['7144b74c-837e-4300-98fa-a504f9a58cdc', '189a3116-f047-4e8e-adac-907a1d82e1ea'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:43:58.250775 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-9d1d3aa4-8ade-4741-bd65-9d294ffb3af0 tempest-VolumesBackupsTest-551128076 None] Delete backup finished, backup 76125475-1d9b-479f-92f9-40237b418af6 deleted. Jul 05 03:43:58.452905 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:58.453019 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:58.555585 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:58.555762 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:58.747236 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:59.176123 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-b3c5ca16-8457-4eb4-a5db-a79990a2dc12 tempest-VolumesBackupsTest-551128076 None] Delete backup started, backup: 8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2. Jul 05 03:43:59.179221 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-b3c5ca16-8457-4eb4-a5db-a79990a2dc12 tempest-VolumesBackupsTest-551128076 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_9ebf67ca50e54c89bb8084c855cb1e32 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:43:59.179502 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-b3c5ca16-8457-4eb4-a5db-a79990a2dc12 tempest-VolumesBackupsTest-551128076 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:43:59.179992 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-b3c5ca16-8457-4eb4-a5db-a79990a2dc12 tempest-VolumesBackupsTest-551128076 None] delete started, backup: 8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2, container: tempest-volumesbackupstest-backup-container-1257406501, prefix: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:43:59.237618 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-b3c5ca16-8457-4eb4-a5db-a79990a2dc12 tempest-VolumesBackupsTest-551128076 None] generated object list: ['volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00001', 'volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00002', 'volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00003', 'volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00004', 'volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00005', 'volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00006', 'volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00007', 'volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00008', 'volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00009', 'volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00010', 'volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00011', 'volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00012', 'volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00013', 'volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00014', 'volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00015', 'volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00016', 'volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00017', 'volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00018', 'volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00019', 'volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00020', 'volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00021', 'volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2_metadata', 'volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:43:59.259280 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-b3c5ca16-8457-4eb4-a5db-a79990a2dc12 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00001 in container: tempest-volumesbackupstest-backup-container-1257406501. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:59.264414 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:59.264487 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:59.278255 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-b3c5ca16-8457-4eb4-a5db-a79990a2dc12 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00002 in container: tempest-volumesbackupstest-backup-container-1257406501. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:59.307021 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-b3c5ca16-8457-4eb4-a5db-a79990a2dc12 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00003 in container: tempest-volumesbackupstest-backup-container-1257406501. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:59.334974 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-b3c5ca16-8457-4eb4-a5db-a79990a2dc12 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00004 in container: tempest-volumesbackupstest-backup-container-1257406501. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:59.355816 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-b3c5ca16-8457-4eb4-a5db-a79990a2dc12 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00005 in container: tempest-volumesbackupstest-backup-container-1257406501. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:59.379624 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-b3c5ca16-8457-4eb4-a5db-a79990a2dc12 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00006 in container: tempest-volumesbackupstest-backup-container-1257406501. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:59.386544 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:59.386689 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:43:59.412888 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-b3c5ca16-8457-4eb4-a5db-a79990a2dc12 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00007 in container: tempest-volumesbackupstest-backup-container-1257406501. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:59.421215 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:43:59.432625 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-b3c5ca16-8457-4eb4-a5db-a79990a2dc12 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00008 in container: tempest-volumesbackupstest-backup-container-1257406501. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:59.452047 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-b3c5ca16-8457-4eb4-a5db-a79990a2dc12 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00009 in container: tempest-volumesbackupstest-backup-container-1257406501. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:59.472118 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-b3c5ca16-8457-4eb4-a5db-a79990a2dc12 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00010 in container: tempest-volumesbackupstest-backup-container-1257406501. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:59.491608 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-b3c5ca16-8457-4eb4-a5db-a79990a2dc12 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00011 in container: tempest-volumesbackupstest-backup-container-1257406501. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:59.513142 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-b3c5ca16-8457-4eb4-a5db-a79990a2dc12 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00012 in container: tempest-volumesbackupstest-backup-container-1257406501. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:59.533241 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-b3c5ca16-8457-4eb4-a5db-a79990a2dc12 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00013 in container: tempest-volumesbackupstest-backup-container-1257406501. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:59.552943 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-b3c5ca16-8457-4eb4-a5db-a79990a2dc12 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00014 in container: tempest-volumesbackupstest-backup-container-1257406501. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:59.575099 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-b3c5ca16-8457-4eb4-a5db-a79990a2dc12 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00015 in container: tempest-volumesbackupstest-backup-container-1257406501. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:59.601654 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-b3c5ca16-8457-4eb4-a5db-a79990a2dc12 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00016 in container: tempest-volumesbackupstest-backup-container-1257406501. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:59.625094 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-b3c5ca16-8457-4eb4-a5db-a79990a2dc12 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00017 in container: tempest-volumesbackupstest-backup-container-1257406501. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:59.628906 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:43:59.645489 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-b3c5ca16-8457-4eb4-a5db-a79990a2dc12 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00018 in container: tempest-volumesbackupstest-backup-container-1257406501. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:59.668229 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-b3c5ca16-8457-4eb4-a5db-a79990a2dc12 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00019 in container: tempest-volumesbackupstest-backup-container-1257406501. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:59.689178 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-b3c5ca16-8457-4eb4-a5db-a79990a2dc12 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00020 in container: tempest-volumesbackupstest-backup-container-1257406501. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:59.712033 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-b3c5ca16-8457-4eb4-a5db-a79990a2dc12 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2-00021 in container: tempest-volumesbackupstest-backup-container-1257406501. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:59.733839 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-b3c5ca16-8457-4eb4-a5db-a79990a2dc12 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2_metadata in container: tempest-volumesbackupstest-backup-container-1257406501. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:59.758278 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-b3c5ca16-8457-4eb4-a5db-a79990a2dc12 tempest-VolumesBackupsTest-551128076 None] deleted object: volume_04edf182-6b4b-4ca0-a438-23709fa3e558/20260705034318/az_nova_backup_8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2_sha256file in container: tempest-volumesbackupstest-backup-container-1257406501. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:43:59.758543 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-b3c5ca16-8457-4eb4-a5db-a79990a2dc12 tempest-VolumesBackupsTest-551128076 None] delete 8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2 finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:43:59.773618 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-b3c5ca16-8457-4eb4-a5db-a79990a2dc12 tempest-VolumesBackupsTest-551128076 None] Created reservations ['7e98796a-1d99-4797-b46b-3bd2ae08c671', 'b42c12ef-e7a8-4b52-92e6-b2f992bd3c37'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:43:59.792194 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-b3c5ca16-8457-4eb4-a5db-a79990a2dc12 tempest-VolumesBackupsTest-551128076 None] Delete backup finished, backup 8754d3c8-ac9b-4180-9f8c-bc88c9b37bf2 deleted. Jul 05 03:43:59.872417 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:43:59.872590 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:43:59.987219 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:43:59.987462 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:00.171091 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:00.451912 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:00.452456 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:00.580312 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:00.580519 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:00.774447 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:01.023040 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:01.023236 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:01.130974 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:01.131148 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:01.323643 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:01.583894 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:01.584479 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:01.715735 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:01.715991 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:01.960138 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:02.221773 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:02.221964 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:02.334633 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:02.334929 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:02.551009 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:02.799004 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:02.799426 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:02.901322 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:02.901489 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:03.110910 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:03.355158 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:03.355365 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:03.460260 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:03.460398 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:03.676782 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:03.931611 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:03.932091 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:04.035559 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:04.035692 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:04.036966 np0000004562 cinder-backup[101413]: DEBUG dbcounter [-] [101413] Writing DB stats cinder:SELECT=216,cinder:UPDATE=63,cinder:INSERT=8 {{(pid=101413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:44:04.215963 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:04.457340 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:04.457482 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:04.555023 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:04.555244 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:04.732292 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:04.976579 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:04.977007 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:05.077100 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:05.077266 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:05.245428 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:05.490556 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:05.490812 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:05.592063 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:05.592667 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:05.785270 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:06.030119 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:06.030525 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:06.127044 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:06.127253 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:06.313807 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:06.557851 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:06.558011 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:06.665232 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:06.665348 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:06.840200 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:07.084540 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:07.084993 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:07.188323 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:07.188506 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:07.382312 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:07.627609 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:07.627841 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:07.725695 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:07.725875 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:07.823995 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:07.942819 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:07.942964 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:08.004238 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:08.004429 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:08.011698 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:44:08.017735 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:44:08.017958 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:44:08.022369 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:44:08.022490 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:44:08.025574 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:44:08.025815 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:44:08.082618 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:44:08.083409 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] _write_metadata started, container name: volumebackups, metadata filename: volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:44:08.105535 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "f90df3cc-e5e4-486f-ab99-6bd61fc1db4d",\n "backup_name": "tempest-type-Backup-1117758538",\n "created_at": "2026-07-05 03:43:53+00:00",\n "objects": [\n {\n "volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "516c9cf6-85c2-49e9-b496-3b1c2a541532",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"516c9cf6-85c2-49e9-b496-3b1c2a541532\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"b7fc80cd98414492aad9972b4676fdb6\\", \\"project_id\\": \\"4891f452f0954ca2ab42df311c6d7f91\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:43:52.000000\\", \\"launched_at\\": \\"2026-07-05T03:43:52.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1366887845\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:43:52.000000\\", \\"updated_at\\": \\"2026-07-05T03:43:53.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:44:08.110446 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] backup f90df3cc-e5e4-486f-ab99-6bd61fc1db4d finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:44:08.233184 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:44:08.251070 np0000004562 sudo[145740]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc Jul 05 03:44:08.251707 np0000004562 sudo[145740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:44:08.550694 np0000004562 sudo[145740]: pam_unix(sudo:session): session closed for user root Jul 05 03:44:08.552896 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc" returned: 0 in 0.319s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:44:08.553537 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-516c9cf6-85c2-49e9-b496-3b1c2a541532', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '516c9cf6-85c2-49e9-b496-3b1c2a541532', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799159', 'path': '/dev/sdc'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:44:08.553726 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:44:08.554117 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:44:08.554523 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-516c9cf6-85c2-49e9-b496-3b1c2a541532', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '516c9cf6-85c2-49e9-b496-3b1c2a541532', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:44:08.564365 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:44:08.564365 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:44:08.564365 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:44:08.564365 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:44:08.564365 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:44:08.564365 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-516c9cf6-85c2-49e9-b496-3b1c2a541532 Jul 05 03:44:08.564365 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:44:08.564365 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:44:08.564365 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 Jul 05 03:44:08.564365 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:44:08.564365 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:44:08.564365 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:44:08.564365 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:44:08.564365 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:44:08.564365 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:44:08.564365 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:44:08.564856 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:44:08.564856 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:44:08.564856 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:44:08.564856 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-516c9cf6-85c2-49e9-b496-3b1c2a541532', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:44:08.584726 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('-m', 'session'): stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:44:08.584726 np0000004562 cinder-backup[101413]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:44:08.584726 np0000004562 cinder-backup[101413]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-516c9cf6-85c2-49e9-b496-3b1c2a541532 (non-flash) Jul 05 03:44:08.584726 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:44:08.585021 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] iscsi session list stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:44:08.585021 np0000004562 cinder-backup[101413]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:44:08.585021 np0000004562 cinder-backup[101413]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-516c9cf6-85c2-49e9-b496-3b1c2a541532 (non-flash) Jul 05 03:44:08.585021 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:44:08.585021 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09', '159'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09', '160'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-516c9cf6-85c2-49e9-b496-3b1c2a541532', '164')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:44:08.585276 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-516c9cf6-85c2-49e9-b496-3b1c2a541532, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-516c9cf6-85c2-49e9-b496-3b1c2a541532', '164')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:44:08.585928 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Resulting device map defaultdict(. at 0x72a470697600>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-516c9cf6-85c2-49e9-b496-3b1c2a541532'): ({'sdc'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:44:08.586118 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Removing single pathed devices sdc {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:44:08.596766 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Flushing IO for device /dev/sdc {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:44:08.604141 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:44:08.667125 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Checking to see if SCSI volumes sdc have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:44:08.667391 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] SCSI volumes sdc have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:44:08.668170 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Checking to see if device paths {'sdc'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:44:08.677726 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Device paths {'sdc'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:44:08.678240 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-516c9cf6-85c2-49e9-b496-3b1c2a541532')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:44:08.688128 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:44:08.715699 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 164, target: iqn.2023-03.storpool.com:os--volume-516c9cf6-85c2-49e9-b496-3b1c2a541532, portal: 192.168.40.100,3260] Jul 05 03:44:08.715699 np0000004562 cinder-backup[101413]: Logout of [sid: 164, target: iqn.2023-03.storpool.com:os--volume-516c9cf6-85c2-49e9-b496-3b1c2a541532, portal: 192.168.40.100,3260] successful. Jul 05 03:44:08.715699 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:44:08.726013 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:44:08.726243 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.172s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:44:08.726381 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] <== disconnect_volume: return (172ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:44:09.764654 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-4524aef9-788f-4535-9182-8e8a9df3a031 tempest-ProjectAdminTests33-657181126 None] Create backup finished. backup: f90df3cc-e5e4-486f-ab99-6bd61fc1db4d. Jul 05 03:44:10.445105 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-0f686b25-199a-4780-a742-cf0ddc822f87 tempest-ProjectAdminTests33-657181126 None] Delete backup started, backup: f90df3cc-e5e4-486f-ab99-6bd61fc1db4d. Jul 05 03:44:10.449690 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-0f686b25-199a-4780-a742-cf0ddc822f87 tempest-ProjectAdminTests33-657181126 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_4891f452f0954ca2ab42df311c6d7f91 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:44:10.450199 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-0f686b25-199a-4780-a742-cf0ddc822f87 tempest-ProjectAdminTests33-657181126 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:44:10.450199 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-0f686b25-199a-4780-a742-cf0ddc822f87 tempest-ProjectAdminTests33-657181126 None] delete started, backup: f90df3cc-e5e4-486f-ab99-6bd61fc1db4d, container: volumebackups, prefix: volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:44:10.496741 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-0f686b25-199a-4780-a742-cf0ddc822f87 tempest-ProjectAdminTests33-657181126 None] generated object list: ['volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00001', 'volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00002', 'volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00003', 'volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00004', 'volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00005', 'volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00006', 'volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00007', 'volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00008', 'volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00009', 'volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00010', 'volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00011', 'volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00012', 'volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00013', 'volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00014', 'volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00015', 'volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00016', 'volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00017', 'volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00018', 'volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00019', 'volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00020', 'volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00021', 'volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d_metadata', 'volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:44:10.526549 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-0f686b25-199a-4780-a742-cf0ddc822f87 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00001 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:10.545829 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-0f686b25-199a-4780-a742-cf0ddc822f87 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00002 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:10.566262 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-0f686b25-199a-4780-a742-cf0ddc822f87 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00003 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:10.587862 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-0f686b25-199a-4780-a742-cf0ddc822f87 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00004 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:10.609014 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-0f686b25-199a-4780-a742-cf0ddc822f87 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00005 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:10.632668 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-0f686b25-199a-4780-a742-cf0ddc822f87 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00006 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:10.653599 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-0f686b25-199a-4780-a742-cf0ddc822f87 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00007 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:10.676230 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-0f686b25-199a-4780-a742-cf0ddc822f87 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00008 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:10.696951 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-0f686b25-199a-4780-a742-cf0ddc822f87 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00009 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:10.721631 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-0f686b25-199a-4780-a742-cf0ddc822f87 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00010 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:10.745251 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-0f686b25-199a-4780-a742-cf0ddc822f87 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00011 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:10.767077 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-0f686b25-199a-4780-a742-cf0ddc822f87 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00012 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:10.786723 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-0f686b25-199a-4780-a742-cf0ddc822f87 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00013 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:10.806459 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-0f686b25-199a-4780-a742-cf0ddc822f87 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00014 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:10.829589 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-0f686b25-199a-4780-a742-cf0ddc822f87 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00015 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:10.859561 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-0f686b25-199a-4780-a742-cf0ddc822f87 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00016 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:10.880786 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-0f686b25-199a-4780-a742-cf0ddc822f87 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00017 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:10.901679 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-0f686b25-199a-4780-a742-cf0ddc822f87 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00018 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:10.922020 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-0f686b25-199a-4780-a742-cf0ddc822f87 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00019 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:10.955181 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-0f686b25-199a-4780-a742-cf0ddc822f87 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00020 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:10.983285 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-0f686b25-199a-4780-a742-cf0ddc822f87 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d-00021 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:11.009245 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-0f686b25-199a-4780-a742-cf0ddc822f87 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d_metadata in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:11.042354 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-0f686b25-199a-4780-a742-cf0ddc822f87 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_516c9cf6-85c2-49e9-b496-3b1c2a541532/20260705034356/az_nova_backup_f90df3cc-e5e4-486f-ab99-6bd61fc1db4d_sha256file in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:11.042663 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-0f686b25-199a-4780-a742-cf0ddc822f87 tempest-ProjectAdminTests33-657181126 None] delete f90df3cc-e5e4-486f-ab99-6bd61fc1db4d finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:44:11.086370 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-0f686b25-199a-4780-a742-cf0ddc822f87 tempest-ProjectAdminTests33-657181126 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:44:11.101635 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-0f686b25-199a-4780-a742-cf0ddc822f87 tempest-ProjectAdminTests33-657181126 None] Created reservations ['6ee429e8-7c4c-4e60-87dc-4cce45a4f9bf', '19f7408d-9d44-4264-9719-d4ad96be3b14'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:44:11.117691 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-0f686b25-199a-4780-a742-cf0ddc822f87 tempest-ProjectAdminTests33-657181126 None] Delete backup finished, backup f90df3cc-e5e4-486f-ab99-6bd61fc1db4d deleted. Jul 05 03:44:11.598487 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-df67275c-efe0-4a64-adf4-4c2723e123a5 tempest-ProjectAdminTests33-657181126 None] Export record started, backup: 0ea5ca0d-7367-454b-a631-0d9f828db381. Jul 05 03:44:11.601607 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-df67275c-efe0-4a64-adf4-4c2723e123a5 tempest-ProjectAdminTests33-657181126 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_4891f452f0954ca2ab42df311c6d7f91 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:44:11.602038 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-df67275c-efe0-4a64-adf4-4c2723e123a5 tempest-ProjectAdminTests33-657181126 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:44:11.602526 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-df67275c-efe0-4a64-adf4-4c2723e123a5 tempest-ProjectAdminTests33-657181126 None] Export record finished, backup 0ea5ca0d-7367-454b-a631-0d9f828db381 exported. Jul 05 03:44:11.782041 np0000004562 cinder-backup[101413]: DEBUG oslo_service.periodic_task [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:44:11.782484 np0000004562 cinder-backup[101413]: DEBUG cinder.manager [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Notifying Schedulers of capabilities ... {{(pid=101413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:44:13.503076 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:44:13.509107 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Create backup started, backup: 53d82340-eb05-4fa9-956a-a14a2b2cc920 volume: 4a43ea89-da69-4ba0-95d2-91d6607b4ac0. Jul 05 03:44:13.519408 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T03:44:13Z,data_timestamp=2026-07-05T03:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-1181985080',encryption_key_id=None,fail_reason=None,host='np0000004562',id=53d82340-eb05-4fa9-956a-a14a2b2cc920,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='4891f452f0954ca2ab42df311c6d7f91',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='b7fc80cd98414492aad9972b4676fdb6',volume_id=4a43ea89-da69-4ba0-95d2-91d6607b4ac0) Jul 05 03:44:13.554906 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_4891f452f0954ca2ab42df311c6d7f91 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:44:13.555193 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:44:13.555684 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:44:13.567524 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:44:13.590674 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:44:13.604210 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:44:13.604550 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:44:13.613011 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:44:13.614312 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:feec:8698', 'fe80::e075:aff:fed9:9a2e', 'fe80::f816:3eff:fe1e:6f4f', 'fe80::e477:baff:fee9:cab5'] Jul 05 03:44:13.614602 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:44:13.614908 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:44:13.615386 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] <== get_connector_properties: return (59ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:44:14.121834 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:44:14.121834 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a43ea89-da69-4ba0-95d2-91d6607b4ac0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a43ea89-da69-4ba0-95d2-91d6607b4ac0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:44:14.122308 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:44:15.884634 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.763s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:44:15.885143 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a43ea89-da69-4ba0-95d2-91d6607b4ac0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a43ea89-da69-4ba0-95d2-91d6607b4ac0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:44:15.900272 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4a43ea89-da69-4ba0-95d2-91d6607b4ac0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:44:15.900886 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4a43ea89-da69-4ba0-95d2-91d6607b4ac0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:44:15.901230 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:44:15.916847 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:44:15.916847 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:44:15.929685 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4a43ea89-da69-4ba0-95d2-91d6607b4ac0] added Jul 05 03:44:15.929685 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:44:15.929685 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:44:15.929685 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:44:15.929685 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:44:15.929685 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:44:15.929685 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:44:15.930020 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:44:15.930551 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0292(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:44:15.930808 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:44:16.932351 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-4a43ea89-da69-4ba0-95d2-91d6607b4ac0 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:44:16.946311 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:44:16.961394 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:44:16.976007 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] iscsiadm ('-m', 'session'): stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:44:16.976007 np0000004562 cinder-backup[101413]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:44:16.976007 np0000004562 cinder-backup[101413]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:44:16.976007 np0000004562 cinder-backup[101413]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:44:16.976007 np0000004562 cinder-backup[101413]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:44:16.976007 np0000004562 cinder-backup[101413]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:44:16.976007 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:44:16.976448 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] iscsi session list stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:44:16.976448 np0000004562 cinder-backup[101413]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:44:16.976448 np0000004562 cinder-backup[101413]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:44:16.976448 np0000004562 cinder-backup[101413]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:44:16.976448 np0000004562 cinder-backup[101413]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:44:16.976448 np0000004562 cinder-backup[101413]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:44:16.976448 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:44:17.030573 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4a43ea89-da69-4ba0-95d2-91d6607b4ac0, portal: 192.168.40.100,3260] Jul 05 03:44:17.030573 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4a43ea89-da69-4ba0-95d2-91d6607b4ac0, portal: 192.168.40.100,3260] successful. Jul 05 03:44:17.030573 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:44:17.043959 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:44:17.061105 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] iscsiadm ('-m', 'session'): stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:44:17.061105 np0000004562 cinder-backup[101413]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:44:17.061105 np0000004562 cinder-backup[101413]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:44:17.061105 np0000004562 cinder-backup[101413]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:44:17.061105 np0000004562 cinder-backup[101413]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:44:17.061105 np0000004562 cinder-backup[101413]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:44:17.061105 np0000004562 cinder-backup[101413]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a43ea89-da69-4ba0-95d2-91d6607b4ac0 (non-flash) Jul 05 03:44:17.061105 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:44:17.061405 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] iscsi session list stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:44:17.061405 np0000004562 cinder-backup[101413]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:44:17.061405 np0000004562 cinder-backup[101413]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:44:17.061405 np0000004562 cinder-backup[101413]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:44:17.061405 np0000004562 cinder-backup[101413]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:44:17.061405 np0000004562 cinder-backup[101413]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:44:17.061405 np0000004562 cinder-backup[101413]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a43ea89-da69-4ba0-95d2-91d6607b4ac0 (non-flash) Jul 05 03:44:17.061405 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:44:17.061549 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4a43ea89-da69-4ba0-95d2-91d6607b4ac0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:44:17.061698 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:44:17.062498 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] HCTL ('13', '-', '-', 0) found on session 169 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:44:17.062662 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Scanning host 13 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:44:17.082851 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Searching for a device in session 169 and hctl ['13', '*', '*', 0] yield: None {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:44:18.080437 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Searching for a device in session 169 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:44:18.080847 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a43ea89-da69-4ba0-95d2-91d6607b4ac0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a43ea89-da69-4ba0-95d2-91d6607b4ac0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:44:18.081386 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.197s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:44:18.081593 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] <== connect_volume: return (3959ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799160', 'path': '/dev/sdh'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:44:18.081986 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:44:18.099875 np0000004562 sudo[146345]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh Jul 05 03:44:18.100589 np0000004562 sudo[146345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:44:18.413663 np0000004562 sudo[146345]: pam_unix(sudo:session): session closed for user root Jul 05 03:44:18.415919 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh" returned: 0 in 0.333s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:44:18.457657 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:44:18.463497 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] _create_container started, container: volumebackups,backup: 53d82340-eb05-4fa9-956a-a14a2b2cc920. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:44:18.498003 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] generate_object_name_prefix: volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920 {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:44:18.502304 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] starting backup of volume: 4a43ea89-da69-4ba0-95d2-91d6607b4ac0, volume size: 1073741824, object names prefix volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:44:18.693827 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:18.938681 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:18.938883 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:19.061225 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:19.061411 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:19.298627 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:19.548147 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:19.548147 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:19.680255 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:19.682690 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:19.853807 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:20.105589 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:20.105839 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:20.216224 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:20.216376 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:20.426242 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:20.688288 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:20.688526 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:20.793161 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:20.793406 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:21.073391 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:21.320461 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:21.320545 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:21.433240 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:21.433698 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:21.621915 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:21.887111 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:21.887271 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:22.001108 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:22.002442 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:22.211823 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:22.490335 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:22.490779 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:22.607302 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:22.607498 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:22.778984 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:23.033841 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:23.034013 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:23.156362 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:23.156537 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:23.368057 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:23.633923 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:23.634311 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:23.739707 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:23.739919 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:23.916062 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:24.159365 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:24.159662 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:24.272144 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:24.272386 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:24.478161 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:24.734996 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:24.735422 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:24.837541 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:24.837727 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:25.021466 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:25.268772 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:25.268917 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:25.373444 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:25.373697 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:25.606521 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:25.858366 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:25.858746 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:25.966203 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:25.966466 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:26.165310 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:26.419890 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:26.420062 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:26.540001 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:26.540240 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:26.743861 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:26.993951 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:26.994357 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:27.113566 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:27.113566 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:27.323275 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:27.605613 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:27.605804 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:27.716129 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:27.716292 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:27.935247 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:28.221006 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:28.221441 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:28.336171 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:28.336352 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:28.534011 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:28.799070 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:28.799212 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:28.919029 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:28.919280 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:29.120205 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:29.415471 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:29.415471 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:29.519024 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:29.519478 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:29.716904 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:29.986950 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:29.987122 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:30.109929 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:30.110148 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:30.234460 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:30.372158 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:30.372158 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:30.477777 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:30.477777 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:30.486687 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:44:30.493970 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:44:30.494153 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:44:30.499614 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:44:30.499859 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:44:30.503641 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:44:30.504044 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:44:30.577396 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:44:30.578118 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] _write_metadata started, container name: volumebackups, metadata filename: volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:44:30.603807 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "53d82340-eb05-4fa9-956a-a14a2b2cc920",\n "backup_name": "tempest-type-Backup-1181985080",\n "created_at": "2026-07-05 03:44:13+00:00",\n "objects": [\n {\n "volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "4a43ea89-da69-4ba0-95d2-91d6607b4ac0",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"4a43ea89-da69-4ba0-95d2-91d6607b4ac0\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"b7fc80cd98414492aad9972b4676fdb6\\", \\"project_id\\": \\"4891f452f0954ca2ab42df311c6d7f91\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:44:12.000000\\", \\"launched_at\\": \\"2026-07-05T03:44:12.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1966601862\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:44:12.000000\\", \\"updated_at\\": \\"2026-07-05T03:44:13.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:44:30.610385 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] backup 53d82340-eb05-4fa9-956a-a14a2b2cc920 finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:44:30.741928 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:44:30.761853 np0000004562 sudo[146730]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh Jul 05 03:44:30.762552 np0000004562 sudo[146730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:44:31.101741 np0000004562 sudo[146730]: pam_unix(sudo:session): session closed for user root Jul 05 03:44:31.105067 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh" returned: 0 in 0.363s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:44:31.105821 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a43ea89-da69-4ba0-95d2-91d6607b4ac0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a43ea89-da69-4ba0-95d2-91d6607b4ac0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799160', 'path': '/dev/sdh'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:44:31.106113 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:44:31.138471 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.032s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:44:31.139215 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a43ea89-da69-4ba0-95d2-91d6607b4ac0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a43ea89-da69-4ba0-95d2-91d6607b4ac0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:44:31.151272 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:44:31.151272 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:44:31.151272 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:44:31.151272 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:44:31.151272 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:44:31.151272 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-4a43ea89-da69-4ba0-95d2-91d6607b4ac0 Jul 05 03:44:31.151272 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:44:31.151272 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:44:31.151272 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f Jul 05 03:44:31.151272 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:44:31.151272 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:44:31.151272 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:44:31.151272 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:44:31.151272 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 Jul 05 03:44:31.151272 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:44:31.151272 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:44:31.151272 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:44:31.151272 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:44:31.151272 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-78eda2ce-df15-419b-9f9a-6f5bf426a80b Jul 05 03:44:31.151272 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:44:31.151272 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:44:31.151272 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:44:31.151272 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:44:31.151272 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:44:31.151272 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:44:31.151272 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:44:31.152086 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:44:31.152086 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:44:31.152086 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:44:31.152086 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a43ea89-da69-4ba0-95d2-91d6607b4ac0', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:44:31.181378 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] iscsiadm ('-m', 'session'): stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:44:31.181378 np0000004562 cinder-backup[101413]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:44:31.181378 np0000004562 cinder-backup[101413]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:44:31.181378 np0000004562 cinder-backup[101413]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:44:31.181378 np0000004562 cinder-backup[101413]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a43ea89-da69-4ba0-95d2-91d6607b4ac0 (non-flash) Jul 05 03:44:31.181378 np0000004562 cinder-backup[101413]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78eda2ce-df15-419b-9f9a-6f5bf426a80b (non-flash) Jul 05 03:44:31.181378 np0000004562 cinder-backup[101413]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78eda2ce-df15-419b-9f9a-6f5bf426a80b (non-flash) Jul 05 03:44:31.181378 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:44:31.181857 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] iscsi session list stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:44:31.181857 np0000004562 cinder-backup[101413]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09 (non-flash) Jul 05 03:44:31.181857 np0000004562 cinder-backup[101413]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:44:31.181857 np0000004562 cinder-backup[101413]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:44:31.181857 np0000004562 cinder-backup[101413]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a43ea89-da69-4ba0-95d2-91d6607b4ac0 (non-flash) Jul 05 03:44:31.181857 np0000004562 cinder-backup[101413]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78eda2ce-df15-419b-9f9a-6f5bf426a80b (non-flash) Jul 05 03:44:31.181857 np0000004562 cinder-backup[101413]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78eda2ce-df15-419b-9f9a-6f5bf426a80b (non-flash) Jul 05 03:44:31.181857 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:44:31.181857 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09', '159'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-139101b4-89c0-4a50-b615-b2c573762e09', '160'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f', '167'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f', '168'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a43ea89-da69-4ba0-95d2-91d6607b4ac0', '169'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78eda2ce-df15-419b-9f9a-6f5bf426a80b', '170'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-78eda2ce-df15-419b-9f9a-6f5bf426a80b', '171')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:44:31.182088 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4a43ea89-da69-4ba0-95d2-91d6607b4ac0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a43ea89-da69-4ba0-95d2-91d6607b4ac0', '169')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:44:31.182960 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Resulting device map defaultdict(. at 0x72a47058d3a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a43ea89-da69-4ba0-95d2-91d6607b4ac0'): ({'sdh'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:44:31.183184 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Removing single pathed devices sdh {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:44:31.197923 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Flushing IO for device /dev/sdh {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:44:31.209264 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:44:31.257894 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Checking to see if SCSI volumes sdh have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:44:31.257894 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] SCSI volumes sdh have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:44:31.259502 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Checking to see if device paths {'sdh'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:44:31.271260 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Device paths {'sdh'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:44:31.271627 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a43ea89-da69-4ba0-95d2-91d6607b4ac0')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:44:31.284375 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:44:31.322941 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 169, target: iqn.2023-03.storpool.com:os--volume-4a43ea89-da69-4ba0-95d2-91d6607b4ac0, portal: 192.168.40.100,3260] Jul 05 03:44:31.322941 np0000004562 cinder-backup[101413]: Logout of [sid: 169, target: iqn.2023-03.storpool.com:os--volume-4a43ea89-da69-4ba0-95d2-91d6607b4ac0, portal: 192.168.40.100,3260] successful. Jul 05 03:44:31.322941 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:44:31.341131 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:44:31.341603 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.203s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:44:31.341876 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] <== disconnect_volume: return (236ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:44:32.369289 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-4e962387-e75a-4a46-be60-fec340ad8dab tempest-ProjectAdminTests33-657181126 None] Create backup finished. backup: 53d82340-eb05-4fa9-956a-a14a2b2cc920. Jul 05 03:44:32.918816 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-a6d2dcb2-2134-4e77-9e33-23008d2b3f77 tempest-ProjectAdminTests33-657181126 None] Export record started, backup: 53d82340-eb05-4fa9-956a-a14a2b2cc920. Jul 05 03:44:32.923966 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-a6d2dcb2-2134-4e77-9e33-23008d2b3f77 tempest-ProjectAdminTests33-657181126 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_4891f452f0954ca2ab42df311c6d7f91 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:44:32.924353 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-a6d2dcb2-2134-4e77-9e33-23008d2b3f77 tempest-ProjectAdminTests33-657181126 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:44:32.924818 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-a6d2dcb2-2134-4e77-9e33-23008d2b3f77 tempest-ProjectAdminTests33-657181126 None] Export record finished, backup 53d82340-eb05-4fa9-956a-a14a2b2cc920 exported. Jul 05 03:44:33.507854 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-0bed3f13-5b22-4ea7-8b9b-df49d7769c90 tempest-ProjectAdminTests33-657181126 None] Import record started, backup_url: eyJkcml2ZXJfaW5mbyI6IHt9LCAiaWQiOiAiMWQ2YmVmOTUtNmEwYi00YmEzLWE5YWUtYmY4NjUwOWYyMzBhIiwgInVzZXJfaWQiOiAiYjdmYzgwY2Q5ODQxNDQ5MmFhZDk5NzJiNDY3NmZkYjYiLCAicHJvamVjdF9pZCI6ICI0ODkxZjQ1MmYwOTU0Y2EyYWI0MmRmMzExYzZkN2Y5MSIsICJ2b2x1bWVfaWQiOiAiNGE0M2VhODktZGE2OS00YmEwLTk1ZDItOTFkNjYwN2I0YWMwIiwgImhvc3QiOiAibnAwMDAwMDA0NTYyIiwgImF2YWlsYWJpbGl0eV96b25lIjogIm5vdmEiLCAiY29udGFpbmVyIjogInZvbHVtZWJhY2t1cHMiLCAicGFyZW50X2lkIjogbnVsbCwgInN0YXR1cyI6ICJhdmFpbGFibGUiLCAiZmFpbF9yZWFzb24iOiBudWxsLCAic2l6ZSI6IDEsICJkaXNwbGF5X25hbWUiOiAidGVtcGVzdC10eXBlLUJhY2t1cC0xMTgxOTg1MDgwIiwgImRpc3BsYXlfZGVzY3JpcHRpb24iOiBudWxsLCAic2VydmljZV9tZXRhZGF0YSI6ICJ2b2x1bWVfNGE0M2VhODktZGE2OS00YmEwLTk1ZDItOTFkNjYwN2I0YWMwLzIwMjYwNzA1MDM0NDE4L2F6X25vdmFfYmFja3VwXzUzZDgyMzQwLWViMDUtNGZhOS05NTZhLWExNGEyYjJjYzkyMCIsICJzZXJ2aWNlIjogImNpbmRlci5iYWNrdXAuZHJpdmVycy5zd2lmdC5Td2lmdEJhY2t1cERyaXZlciIsICJvYmplY3RfY291bnQiOiAyMSwgInRlbXBfdm9sdW1lX2lkIjogbnVsbCwgInRlbXBfc25hcHNob3RfaWQiOiBudWxsLCAibnVtX2RlcGVuZGVudF9iYWNrdXBzIjogMCwgInNuYXBzaG90X2lkIjogbnVsbCwgImRhdGFfdGltZXN0YW1wIjogIjIwMjYtMDctMDVUMDM6NDQ6MTNaIiwgInJlc3RvcmVfdm9sdW1lX2lkIjogbnVsbCwgIm1ldGFkYXRhIjoge30sICJlbmNyeXB0aW9uX2tleV9pZCI6IG51bGwsICJjcmVhdGVkX2F0IjogIjIwMjYtMDctMDVUMDM6NDQ6MTNaIiwgInVwZGF0ZWRfYXQiOiAiMjAyNi0wNy0wNVQwMzo0NDozMloiLCAiZGVsZXRlZF9hdCI6IG51bGwsICJkZWxldGVkIjogZmFsc2V9. Jul 05 03:44:33.508867 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-0bed3f13-5b22-4ea7-8b9b-df49d7769c90 tempest-ProjectAdminTests33-657181126 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_4891f452f0954ca2ab42df311c6d7f91 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:44:33.509035 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-0bed3f13-5b22-4ea7-8b9b-df49d7769c90 tempest-ProjectAdminTests33-657181126 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:44:33.552454 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-0bed3f13-5b22-4ea7-8b9b-df49d7769c90 tempest-ProjectAdminTests33-657181126 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:44:33.569665 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-0bed3f13-5b22-4ea7-8b9b-df49d7769c90 tempest-ProjectAdminTests33-657181126 None] Import record id 1d6bef95-6a0b-4ba3-a9ae-bf86509f230a metadata from driver finished. Jul 05 03:44:34.602441 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-1cb64358-9cb7-4993-b45e-406fe3bafd92 tempest-ProjectAdminTests33-657181126 None] Delete backup started, backup: 1d6bef95-6a0b-4ba3-a9ae-bf86509f230a. Jul 05 03:44:34.608856 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-1cb64358-9cb7-4993-b45e-406fe3bafd92 tempest-ProjectAdminTests33-657181126 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_4891f452f0954ca2ab42df311c6d7f91 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:44:34.609113 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-1cb64358-9cb7-4993-b45e-406fe3bafd92 tempest-ProjectAdminTests33-657181126 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:44:34.609237 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1cb64358-9cb7-4993-b45e-406fe3bafd92 tempest-ProjectAdminTests33-657181126 None] delete started, backup: 1d6bef95-6a0b-4ba3-a9ae-bf86509f230a, container: volumebackups, prefix: volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:44:34.661533 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1cb64358-9cb7-4993-b45e-406fe3bafd92 tempest-ProjectAdminTests33-657181126 None] generated object list: ['volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00001', 'volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00002', 'volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00003', 'volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00004', 'volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00005', 'volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00006', 'volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00007', 'volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00008', 'volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00009', 'volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00010', 'volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00011', 'volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00012', 'volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00013', 'volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00014', 'volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00015', 'volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00016', 'volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00017', 'volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00018', 'volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00019', 'volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00020', 'volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00021', 'volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920_metadata', 'volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:44:34.691266 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1cb64358-9cb7-4993-b45e-406fe3bafd92 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00001 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:34.716898 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1cb64358-9cb7-4993-b45e-406fe3bafd92 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00002 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:34.741098 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1cb64358-9cb7-4993-b45e-406fe3bafd92 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00003 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:34.759520 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1cb64358-9cb7-4993-b45e-406fe3bafd92 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00004 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:34.781905 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1cb64358-9cb7-4993-b45e-406fe3bafd92 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00005 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:34.807796 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1cb64358-9cb7-4993-b45e-406fe3bafd92 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00006 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:34.832104 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1cb64358-9cb7-4993-b45e-406fe3bafd92 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00007 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:34.852645 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1cb64358-9cb7-4993-b45e-406fe3bafd92 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00008 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:34.886043 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1cb64358-9cb7-4993-b45e-406fe3bafd92 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00009 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:34.932585 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1cb64358-9cb7-4993-b45e-406fe3bafd92 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00010 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:34.967202 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1cb64358-9cb7-4993-b45e-406fe3bafd92 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00011 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:34.994334 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1cb64358-9cb7-4993-b45e-406fe3bafd92 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00012 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:35.017085 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1cb64358-9cb7-4993-b45e-406fe3bafd92 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00013 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:35.039933 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1cb64358-9cb7-4993-b45e-406fe3bafd92 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00014 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:35.065406 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1cb64358-9cb7-4993-b45e-406fe3bafd92 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00015 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:35.085231 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1cb64358-9cb7-4993-b45e-406fe3bafd92 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00016 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:35.113460 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1cb64358-9cb7-4993-b45e-406fe3bafd92 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00017 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:35.138651 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1cb64358-9cb7-4993-b45e-406fe3bafd92 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00018 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:35.159145 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1cb64358-9cb7-4993-b45e-406fe3bafd92 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00019 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:35.180193 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1cb64358-9cb7-4993-b45e-406fe3bafd92 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00020 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:35.198694 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1cb64358-9cb7-4993-b45e-406fe3bafd92 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920-00021 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:35.217149 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1cb64358-9cb7-4993-b45e-406fe3bafd92 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920_metadata in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:35.235551 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1cb64358-9cb7-4993-b45e-406fe3bafd92 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920_sha256file in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:44:35.235787 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1cb64358-9cb7-4993-b45e-406fe3bafd92 tempest-ProjectAdminTests33-657181126 None] delete 1d6bef95-6a0b-4ba3-a9ae-bf86509f230a finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:44:35.273362 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-1cb64358-9cb7-4993-b45e-406fe3bafd92 tempest-ProjectAdminTests33-657181126 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:44:35.290857 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-1cb64358-9cb7-4993-b45e-406fe3bafd92 tempest-ProjectAdminTests33-657181126 None] Created reservations ['d42c8599-6dd8-48be-82d8-f1f636254e61', '778a5766-195f-418f-80cf-557d1c728c50'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:44:35.313050 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-1cb64358-9cb7-4993-b45e-406fe3bafd92 tempest-ProjectAdminTests33-657181126 None] Delete backup finished, backup 1d6bef95-6a0b-4ba3-a9ae-bf86509f230a deleted. Jul 05 03:44:38.262366 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Create backup started, backup: 6b8d1752-fa56-4bca-8f2a-2bd74befe0e4 volume: f9dd5002-8047-4f56-a4b9-b9f31bbe33fb. Jul 05 03:44:38.269955 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T03:44:38Z,data_timestamp=2026-07-05T03:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-1963875510',encryption_key_id=None,fail_reason=None,host='np0000004562',id=6b8d1752-fa56-4bca-8f2a-2bd74befe0e4,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='4891f452f0954ca2ab42df311c6d7f91',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='b7fc80cd98414492aad9972b4676fdb6',volume_id=f9dd5002-8047-4f56-a4b9-b9f31bbe33fb) Jul 05 03:44:38.310101 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_4891f452f0954ca2ab42df311c6d7f91 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:44:38.310101 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:44:38.310396 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:44:38.324225 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:44:38.354083 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:44:38.370605 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:44:38.371847 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:44:38.380820 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:44:38.382425 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:feec:8698', 'fe80::e075:aff:fed9:9a2e', 'fe80::f816:3eff:fe6c:6eb0', 'fe80::2c3f:65ff:fe45:1d49', 'fe80::f816:3eff:fe3a:c685', 'fe80::80e7:33ff:fe1d:273b', 'fe80::f816:3eff:feec:87ae', 'fe80::4871:a0ff:feb5:e1d'] Jul 05 03:44:38.382693 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:44:38.382903 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:44:38.383253 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] <== get_connector_properties: return (72ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:44:38.890046 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:44:38.890575 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f9dd5002-8047-4f56-a4b9-b9f31bbe33fb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f9dd5002-8047-4f56-a4b9-b9f31bbe33fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:44:38.891148 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:44:38.891662 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:44:38.891952 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f9dd5002-8047-4f56-a4b9-b9f31bbe33fb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f9dd5002-8047-4f56-a4b9-b9f31bbe33fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:44:38.903239 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f9dd5002-8047-4f56-a4b9-b9f31bbe33fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:44:38.903723 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f9dd5002-8047-4f56-a4b9-b9f31bbe33fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:44:38.903994 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:44:38.916076 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:44:38.916076 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:44:38.929331 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f9dd5002-8047-4f56-a4b9-b9f31bbe33fb] added Jul 05 03:44:38.929331 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:44:38.929331 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:44:38.929331 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:44:38.929331 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:44:38.929331 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:44:38.929331 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:44:38.929543 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:44:38.930041 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0259(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:44:38.930307 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:44:39.931950 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-f9dd5002-8047-4f56-a4b9-b9f31bbe33fb Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:44:39.942525 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:44:39.954751 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:44:39.968353 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('-m', 'session'): stdout=tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:44:39.968353 np0000004562 cinder-backup[101413]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:44:39.968353 np0000004562 cinder-backup[101413]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:44:39.968353 np0000004562 cinder-backup[101413]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:44:39.968353 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:44:39.968589 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] iscsi session list stdout=tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:44:39.968589 np0000004562 cinder-backup[101413]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:44:39.968589 np0000004562 cinder-backup[101413]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:44:39.968589 np0000004562 cinder-backup[101413]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:44:39.968589 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:44:39.999166 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f9dd5002-8047-4f56-a4b9-b9f31bbe33fb, portal: 192.168.40.100,3260] Jul 05 03:44:39.999166 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f9dd5002-8047-4f56-a4b9-b9f31bbe33fb, portal: 192.168.40.100,3260] successful. Jul 05 03:44:39.999166 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:44:40.013411 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:44:40.028968 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('-m', 'session'): stdout=tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:44:40.028968 np0000004562 cinder-backup[101413]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:44:40.028968 np0000004562 cinder-backup[101413]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:44:40.028968 np0000004562 cinder-backup[101413]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:44:40.028968 np0000004562 cinder-backup[101413]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9dd5002-8047-4f56-a4b9-b9f31bbe33fb (non-flash) Jul 05 03:44:40.028968 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:44:40.029408 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] iscsi session list stdout=tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:44:40.029408 np0000004562 cinder-backup[101413]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:44:40.029408 np0000004562 cinder-backup[101413]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:44:40.029408 np0000004562 cinder-backup[101413]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:44:40.029408 np0000004562 cinder-backup[101413]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9dd5002-8047-4f56-a4b9-b9f31bbe33fb (non-flash) Jul 05 03:44:40.029408 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:44:40.029672 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f9dd5002-8047-4f56-a4b9-b9f31bbe33fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.126s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:44:40.029672 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:44:40.030360 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] HCTL ('7', '-', '-', 0) found on session 174 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:44:40.030537 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:44:40.050557 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Searching for a device in session 174 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:44:40.050612 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f9dd5002-8047-4f56-a4b9-b9f31bbe33fb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f9dd5002-8047-4f56-a4b9-b9f31bbe33fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:44:41.053324 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.162s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:44:41.053685 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] <== connect_volume: return (2162ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799169', 'path': '/dev/sdb'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:44:41.053896 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:44:41.074203 np0000004562 sudo[147198]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 05 03:44:41.074994 np0000004562 sudo[147198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:44:41.416940 np0000004562 sudo[147198]: pam_unix(sudo:session): session closed for user root Jul 05 03:44:41.420419 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.365s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:44:41.469658 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:44:41.475806 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] _create_container started, container: volumebackups,backup: 6b8d1752-fa56-4bca-8f2a-2bd74befe0e4. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:44:41.507491 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] generate_object_name_prefix: volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4 {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:44:41.516292 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] starting backup of volume: f9dd5002-8047-4f56-a4b9-b9f31bbe33fb, volume size: 1073741824, object names prefix volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:44:41.725417 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:41.982239 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:41.982430 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:42.084502 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:42.084996 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:42.274527 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:42.533922 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:42.534156 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:42.648042 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:42.648201 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:42.875957 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:43.118135 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:43.118555 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:43.236772 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:43.236974 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:43.465188 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:43.717930 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:43.718112 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:43.825082 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:43.825289 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:44.032379 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:44.283064 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:44.283421 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:44.386908 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:44.387121 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:44.589396 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:44.849615 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:44.849808 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:44.964117 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:44.964308 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:45.201105 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:45.472014 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:45.472423 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:45.579439 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:45.579691 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:45.796704 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:46.056875 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:46.057056 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:46.178785 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:46.178785 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:46.422172 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:46.683954 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:46.683954 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:46.792537 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:46.792774 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:47.018235 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:47.275544 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:47.275693 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:47.380293 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:47.380530 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:47.585330 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:47.836673 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:47.836673 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:47.952658 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:47.952814 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:48.163787 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:48.417170 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:48.417427 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:48.521193 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:48.521430 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:48.732073 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:48.984191 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:48.984593 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:49.096886 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:49.096935 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:49.309772 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:49.572195 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:49.572466 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:49.697894 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:49.698149 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:49.881440 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:50.120987 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:50.121434 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:50.224823 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:50.225089 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:50.417487 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:50.730751 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:50.730920 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:50.859271 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:50.859492 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:51.047942 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:51.315946 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:51.316336 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:51.430958 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:51.431108 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:51.625324 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:51.880063 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:51.881637 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:51.991751 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:51.991931 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:52.197154 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:52.461349 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:52.461806 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:52.574263 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:52.574479 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:52.793742 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:53.047776 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:53.047967 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:53.161261 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:53.161261 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:53.260643 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:44:53.396816 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:44:53.397071 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:44:53.473823 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] backup MD5 for volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:44:53.474433 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:44:53.482270 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:44:53.491126 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:44:53.493042 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:44:53.499482 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:44:53.501322 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:44:53.506806 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:44:53.506806 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:44:53.593341 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:44:53.594136 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] _write_metadata started, container name: volumebackups, metadata filename: volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:44:53.631975 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "6b8d1752-fa56-4bca-8f2a-2bd74befe0e4",\n "backup_name": "tempest-type-Backup-1963875510",\n "created_at": "2026-07-05 03:44:38+00:00",\n "objects": [\n {\n "volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "f9dd5002-8047-4f56-a4b9-b9f31bbe33fb",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"f9dd5002-8047-4f56-a4b9-b9f31bbe33fb\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"b7fc80cd98414492aad9972b4676fdb6\\", \\"project_id\\": \\"4891f452f0954ca2ab42df311c6d7f91\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:44:37.000000\\", \\"launched_at\\": \\"2026-07-05T03:44:37.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1021838964\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:44:37.000000\\", \\"updated_at\\": \\"2026-07-05T03:44:38.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:44:53.638092 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] backup 6b8d1752-fa56-4bca-8f2a-2bd74befe0e4 finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:44:53.778833 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:44:53.797494 np0000004562 sudo[147456]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 05 03:44:53.798264 np0000004562 sudo[147456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:44:54.162007 np0000004562 sudo[147456]: pam_unix(sudo:session): session closed for user root Jul 05 03:44:54.164324 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.385s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:44:54.165011 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f9dd5002-8047-4f56-a4b9-b9f31bbe33fb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f9dd5002-8047-4f56-a4b9-b9f31bbe33fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799169', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:44:54.165459 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:44:54.165792 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:44:54.166258 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f9dd5002-8047-4f56-a4b9-b9f31bbe33fb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f9dd5002-8047-4f56-a4b9-b9f31bbe33fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:44:54.176983 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:44:54.176983 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:44:54.176983 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:44:54.176983 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:44:54.176983 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:44:54.176983 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf Jul 05 03:44:54.176983 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:44:54.176983 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:44:54.176983 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:44:54.176983 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:44:54.176983 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f Jul 05 03:44:54.176983 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:44:54.176983 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:44:54.176983 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:44:54.176983 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:44:54.176983 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-f9dd5002-8047-4f56-a4b9-b9f31bbe33fb Jul 05 03:44:54.176983 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:44:54.176983 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:44:54.176983 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:44:54.176983 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:44:54.176983 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:44:54.177484 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:44:54.177484 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:44:54.177484 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:44:54.177484 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9dd5002-8047-4f56-a4b9-b9f31bbe33fb', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:44:54.202837 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('-m', 'session'): stdout=tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:44:54.202837 np0000004562 cinder-backup[101413]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:44:54.202837 np0000004562 cinder-backup[101413]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:44:54.202837 np0000004562 cinder-backup[101413]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:44:54.202837 np0000004562 cinder-backup[101413]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9dd5002-8047-4f56-a4b9-b9f31bbe33fb (non-flash) Jul 05 03:44:54.202837 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:44:54.203104 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] iscsi session list stdout=tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:44:54.203104 np0000004562 cinder-backup[101413]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:44:54.203104 np0000004562 cinder-backup[101413]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:44:54.203104 np0000004562 cinder-backup[101413]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:44:54.203104 np0000004562 cinder-backup[101413]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9dd5002-8047-4f56-a4b9-b9f31bbe33fb (non-flash) Jul 05 03:44:54.203104 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:44:54.203213 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f', '167'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f', '168'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf', '172'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf', '173'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9dd5002-8047-4f56-a4b9-b9f31bbe33fb', '174')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:44:54.203410 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f9dd5002-8047-4f56-a4b9-b9f31bbe33fb, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9dd5002-8047-4f56-a4b9-b9f31bbe33fb', '174')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:44:54.204654 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Resulting device map defaultdict(. at 0x72a4944edee0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9dd5002-8047-4f56-a4b9-b9f31bbe33fb'): ({'sdb'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:44:54.204968 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Removing single pathed devices sdb {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:44:54.214994 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Flushing IO for device /dev/sdb {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:44:54.223073 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:44:54.281621 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:44:54.281877 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:44:54.283037 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:44:54.296032 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:44:54.296383 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9dd5002-8047-4f56-a4b9-b9f31bbe33fb')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:44:54.307593 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:44:54.340036 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 174, target: iqn.2023-03.storpool.com:os--volume-f9dd5002-8047-4f56-a4b9-b9f31bbe33fb, portal: 192.168.40.100,3260] Jul 05 03:44:54.340036 np0000004562 cinder-backup[101413]: Logout of [sid: 174, target: iqn.2023-03.storpool.com:os--volume-f9dd5002-8047-4f56-a4b9-b9f31bbe33fb, portal: 192.168.40.100,3260] successful. Jul 05 03:44:54.340036 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:44:54.355982 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:44:54.356288 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.190s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:44:54.356475 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] <== disconnect_volume: return (190ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:44:55.377266 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-77f4cf0b-15ec-4006-8be8-5a49bbb32025 tempest-ProjectAdminTests33-657181126 None] Create backup finished. backup: 6b8d1752-fa56-4bca-8f2a-2bd74befe0e4. Jul 05 03:44:55.674934 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-8fde9d25-437b-43e8-8116-b06f93e5829c tempest-ProjectAdminTests33-657181126 None] Reset backup status started, backup_id: 6b8d1752-fa56-4bca-8f2a-2bd74befe0e4, status: error. Jul 05 03:44:55.674934 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-8fde9d25-437b-43e8-8116-b06f93e5829c tempest-ProjectAdminTests33-657181126 None] Backup service: cinder.backup.drivers.swift.SwiftBackupDriver. Jul 05 03:44:57.974922 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Restore backup started, backup: 0ea5ca0d-7367-454b-a631-0d9f828db381 volume: 96d864fe-0e62-42dc-8da3-1e262ff640e1. Jul 05 03:44:57.994749 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_4891f452f0954ca2ab42df311c6d7f91 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:44:57.995575 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:44:57.996559 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:44:58.007509 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:44:58.027278 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:44:58.043029 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:44:58.043477 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:44:58.052309 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:44:58.053861 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe6c:6eb0', 'fe80::2c3f:65ff:fe45:1d49', 'fe80::f816:3eff:fe3a:c685', 'fe80::80e7:33ff:fe1d:273b', 'fe80::f816:3eff:feec:87ae', 'fe80::4871:a0ff:feb5:e1d', 'fe80::f816:3eff:fe28:c9a9', 'fe80::a82c:edff:fe00:fc0a'] Jul 05 03:44:58.054051 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:44:58.054220 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:44:58.054574 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] <== get_connector_properties: return (57ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:44:59.065644 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:44:59.066220 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96d864fe-0e62-42dc-8da3-1e262ff640e1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96d864fe-0e62-42dc-8da3-1e262ff640e1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:44:59.066474 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:44:59.431067 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.364s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:44:59.431441 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96d864fe-0e62-42dc-8da3-1e262ff640e1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96d864fe-0e62-42dc-8da3-1e262ff640e1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:44:59.444773 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-96d864fe-0e62-42dc-8da3-1e262ff640e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:44:59.445278 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-96d864fe-0e62-42dc-8da3-1e262ff640e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:44:59.445553 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:44:59.458878 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:44:59.458878 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:44:59.474643 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-96d864fe-0e62-42dc-8da3-1e262ff640e1] added Jul 05 03:44:59.474643 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:44:59.474643 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:44:59.474643 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:44:59.474643 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:44:59.474643 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:44:59.474643 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:44:59.474893 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:44:59.475238 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0296(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:44:59.475438 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:45:00.476721 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-96d864fe-0e62-42dc-8da3-1e262ff640e1 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:45:00.491181 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:45:00.505053 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:45:00.521642 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('-m', 'session'): stdout=tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:45:00.521642 np0000004562 cinder-backup[101413]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:45:00.521642 np0000004562 cinder-backup[101413]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:45:00.521642 np0000004562 cinder-backup[101413]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:45:00.521642 np0000004562 cinder-backup[101413]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02fb9bb6-f74a-4cd7-be7c-235e04e842d7 (non-flash) Jul 05 03:45:00.521642 np0000004562 cinder-backup[101413]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02fb9bb6-f74a-4cd7-be7c-235e04e842d7 (non-flash) Jul 05 03:45:00.521642 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:45:00.521894 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] iscsi session list stdout=tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:45:00.521894 np0000004562 cinder-backup[101413]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:45:00.521894 np0000004562 cinder-backup[101413]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:45:00.521894 np0000004562 cinder-backup[101413]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:45:00.521894 np0000004562 cinder-backup[101413]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02fb9bb6-f74a-4cd7-be7c-235e04e842d7 (non-flash) Jul 05 03:45:00.521894 np0000004562 cinder-backup[101413]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02fb9bb6-f74a-4cd7-be7c-235e04e842d7 (non-flash) Jul 05 03:45:00.521894 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:45:00.567072 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-96d864fe-0e62-42dc-8da3-1e262ff640e1, portal: 192.168.40.100,3260] Jul 05 03:45:00.567072 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-96d864fe-0e62-42dc-8da3-1e262ff640e1, portal: 192.168.40.100,3260] successful. Jul 05 03:45:00.567072 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:45:00.574575 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:45:00.591447 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('-m', 'session'): stdout=tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:45:00.591447 np0000004562 cinder-backup[101413]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:45:00.591447 np0000004562 cinder-backup[101413]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:45:00.591447 np0000004562 cinder-backup[101413]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:45:00.591447 np0000004562 cinder-backup[101413]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02fb9bb6-f74a-4cd7-be7c-235e04e842d7 (non-flash) Jul 05 03:45:00.591447 np0000004562 cinder-backup[101413]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02fb9bb6-f74a-4cd7-be7c-235e04e842d7 (non-flash) Jul 05 03:45:00.591447 np0000004562 cinder-backup[101413]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d864fe-0e62-42dc-8da3-1e262ff640e1 (non-flash) Jul 05 03:45:00.591447 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:45:00.591778 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] iscsi session list stdout=tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:45:00.591778 np0000004562 cinder-backup[101413]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0f197a4-1f5a-4acf-a47a-c3d539fb481f (non-flash) Jul 05 03:45:00.591778 np0000004562 cinder-backup[101413]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:45:00.591778 np0000004562 cinder-backup[101413]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ca3c32a5-1167-4b90-8b78-f2862ae6a0bf (non-flash) Jul 05 03:45:00.591778 np0000004562 cinder-backup[101413]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02fb9bb6-f74a-4cd7-be7c-235e04e842d7 (non-flash) Jul 05 03:45:00.591778 np0000004562 cinder-backup[101413]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02fb9bb6-f74a-4cd7-be7c-235e04e842d7 (non-flash) Jul 05 03:45:00.591778 np0000004562 cinder-backup[101413]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d864fe-0e62-42dc-8da3-1e262ff640e1 (non-flash) Jul 05 03:45:00.591778 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:45:00.592123 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-96d864fe-0e62-42dc-8da3-1e262ff640e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.147s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:45:00.592330 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:45:00.593131 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] HCTL ('10', '-', '-', 0) found on session 177 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:45:00.593282 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Scanning host 10 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:45:00.611806 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Searching for a device in session 177 and hctl ['10', '*', '*', 0] yield: sde {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:45:00.612025 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96d864fe-0e62-42dc-8da3-1e262ff640e1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96d864fe-0e62-42dc-8da3-1e262ff640e1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:45:01.615299 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.184s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:45:01.615768 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] <== connect_volume: return (2548ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799173', 'path': '/dev/sde'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:45:01.616005 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:45:01.638148 np0000004562 sudo[147888]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde Jul 05 03:45:01.639017 np0000004562 sudo[147888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:45:01.973817 np0000004562 sudo[147888]: pam_unix(sudo:session): session closed for user root Jul 05 03:45:01.976015 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde" returned: 0 in 0.359s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:45:01.980183 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] starting restore of backup volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381 container: volumebackups, to new volume 96d864fe-0e62-42dc-8da3-1e262ff640e1, backup: 0ea5ca0d-7367-454b-a631-0d9f828db381. {{(pid=101413) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jul 05 03:45:01.980619 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] _read_metadata started, container name: volumebackups, metadata filename: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381_metadata. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] _read_metadata finished. Metadata: { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "backup_description": null, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "backup_id": "0ea5ca0d-7367-454b-a631-0d9f828db381", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "backup_name": "tempest-type-Backup-912020007", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "created_at": "2026-07-05 03:43:09+00:00", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "objects": [ Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00001": { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "offset": 0 Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00002": { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "offset": 52428800 Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00003": { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "offset": 104857600 Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00004": { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "offset": 157286400 Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00005": { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "offset": 209715200 Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00006": { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "offset": 262144000 Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00007": { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "offset": 314572800 Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00008": { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "offset": 367001600 Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00009": { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "offset": 419430400 Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00010": { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "offset": 471859200 Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00011": { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "offset": 524288000 Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00012": { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "offset": 576716800 Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00013": { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "offset": 629145600 Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00014": { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "offset": 681574400 Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00015": { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "offset": 734003200 Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00016": { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "offset": 786432000 Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00017": { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "offset": 838860800 Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00018": { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "offset": 891289600 Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00019": { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "offset": 943718400 Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00020": { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "offset": 996147200 Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00021": { Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "length": 25165824, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "offset": 1048576000 Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: ], Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "parent_id": null, Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "version": "1.0.0", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "volume_id": "98295ac8-1979-4056-8a5b-bb5d71f20e92", Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"98295ac8-1979-4056-8a5b-bb5d71f20e92\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"b7fc80cd98414492aad9972b4676fdb6\", \"project_id\": \"4891f452f0954ca2ab42df311c6d7f91\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004562@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T03:43:07.000000\", \"launched_at\": \"2026-07-05T03:43:08.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumeV3RbacBaseTests-Volume-1042948977\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"ac464b70-f08d-447b-aa26-2823b4948fc2\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T03:43:07.000000\", \"updated_at\": \"2026-07-05T03:43:09.000000\"}}" Jul 05 03:45:02.008279 np0000004562 cinder-backup[101413]: }. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 03:45:02.015006 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Restoring backup version 1.0.0 {{(pid=101413) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jul 05 03:45:02.015006 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] _read_metadata started, container name: volumebackups, metadata filename: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381_metadata. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] _read_metadata finished. Metadata: { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "backup_description": null, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "backup_id": "0ea5ca0d-7367-454b-a631-0d9f828db381", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "backup_name": "tempest-type-Backup-912020007", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "created_at": "2026-07-05 03:43:09+00:00", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "objects": [ Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00001": { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "offset": 0 Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00002": { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "offset": 52428800 Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00003": { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "offset": 104857600 Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00004": { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "offset": 157286400 Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00005": { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "offset": 209715200 Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00006": { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "offset": 262144000 Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00007": { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "offset": 314572800 Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00008": { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "offset": 367001600 Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00009": { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "offset": 419430400 Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00010": { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "offset": 471859200 Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00011": { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "offset": 524288000 Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00012": { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "offset": 576716800 Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00013": { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "offset": 629145600 Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00014": { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "offset": 681574400 Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00015": { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "offset": 734003200 Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00016": { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "offset": 786432000 Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00017": { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "offset": 838860800 Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00018": { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "offset": 891289600 Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00019": { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "offset": 943718400 Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00020": { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "offset": 996147200 Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: }, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00021": { Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "length": 25165824, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "offset": 1048576000 Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: } Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: ], Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "parent_id": null, Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "version": "1.0.0", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "volume_id": "98295ac8-1979-4056-8a5b-bb5d71f20e92", Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"98295ac8-1979-4056-8a5b-bb5d71f20e92\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"b7fc80cd98414492aad9972b4676fdb6\", \"project_id\": \"4891f452f0954ca2ab42df311c6d7f91\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004562@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T03:43:07.000000\", \"launched_at\": \"2026-07-05T03:43:08.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumeV3RbacBaseTests-Volume-1042948977\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"ac464b70-f08d-447b-aa26-2823b4948fc2\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T03:43:07.000000\", \"updated_at\": \"2026-07-05T03:43:09.000000\"}}" Jul 05 03:45:02.037895 np0000004562 cinder-backup[101413]: }. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 03:45:02.042321 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] v1 volume backup restore of 0ea5ca0d-7367-454b-a631-0d9f828db381 started. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 05 03:45:02.042321 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] metadata_object_names = ['volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00001', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00002', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00003', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00004', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00005', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00006', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00007', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00008', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00009', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00010', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00011', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00012', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00013', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00014', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00015', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00016', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00017', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00018', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00019', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00020', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00021']. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 05 03:45:02.092109 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] generated object list: ['volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00001', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00002', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00003', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00004', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00005', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00006', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00007', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00008', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00009', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00010', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00011', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00012', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00013', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00014', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00015', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00016', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00017', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00018', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00019', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00020', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00021', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381_metadata', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:45:02.142114 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:45:02.146474 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] restoring object. backup: 0ea5ca0d-7367-454b-a631-0d9f828db381, container: volumebackups, object name: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00001, volume: 96d864fe-0e62-42dc-8da3-1e262ff640e1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:45:02.167612 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:45:02.507353 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] restoring object. backup: 0ea5ca0d-7367-454b-a631-0d9f828db381, container: volumebackups, object name: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00002, volume: 96d864fe-0e62-42dc-8da3-1e262ff640e1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:45:02.521533 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:45:02.861556 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] restoring object. backup: 0ea5ca0d-7367-454b-a631-0d9f828db381, container: volumebackups, object name: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00003, volume: 96d864fe-0e62-42dc-8da3-1e262ff640e1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:45:02.885152 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:45:03.629508 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] restoring object. backup: 0ea5ca0d-7367-454b-a631-0d9f828db381, container: volumebackups, object name: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00004, volume: 96d864fe-0e62-42dc-8da3-1e262ff640e1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:45:03.629508 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:45:03.658924 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] restoring object. backup: 0ea5ca0d-7367-454b-a631-0d9f828db381, container: volumebackups, object name: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00005, volume: 96d864fe-0e62-42dc-8da3-1e262ff640e1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:45:03.675946 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:45:04.030512 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] restoring object. backup: 0ea5ca0d-7367-454b-a631-0d9f828db381, container: volumebackups, object name: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00006, volume: 96d864fe-0e62-42dc-8da3-1e262ff640e1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:45:04.046643 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:45:04.385989 np0000004562 cinder-backup[101413]: DEBUG dbcounter [-] [101413] Writing DB stats cinder:SELECT=102,cinder:UPDATE=30,cinder:INSERT=4 {{(pid=101413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:45:04.388237 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] restoring object. backup: 0ea5ca0d-7367-454b-a631-0d9f828db381, container: volumebackups, object name: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00007, volume: 96d864fe-0e62-42dc-8da3-1e262ff640e1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:45:04.406672 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:45:04.748175 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] restoring object. backup: 0ea5ca0d-7367-454b-a631-0d9f828db381, container: volumebackups, object name: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00008, volume: 96d864fe-0e62-42dc-8da3-1e262ff640e1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:45:04.765176 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:45:05.128559 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] restoring object. backup: 0ea5ca0d-7367-454b-a631-0d9f828db381, container: volumebackups, object name: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00009, volume: 96d864fe-0e62-42dc-8da3-1e262ff640e1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:45:05.146352 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:45:05.492453 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] restoring object. backup: 0ea5ca0d-7367-454b-a631-0d9f828db381, container: volumebackups, object name: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00010, volume: 96d864fe-0e62-42dc-8da3-1e262ff640e1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:45:05.513698 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:45:05.861990 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] restoring object. backup: 0ea5ca0d-7367-454b-a631-0d9f828db381, container: volumebackups, object name: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00011, volume: 96d864fe-0e62-42dc-8da3-1e262ff640e1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:45:05.878151 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:45:06.249818 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] restoring object. backup: 0ea5ca0d-7367-454b-a631-0d9f828db381, container: volumebackups, object name: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00012, volume: 96d864fe-0e62-42dc-8da3-1e262ff640e1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:45:06.271496 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:45:06.649551 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] restoring object. backup: 0ea5ca0d-7367-454b-a631-0d9f828db381, container: volumebackups, object name: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00013, volume: 96d864fe-0e62-42dc-8da3-1e262ff640e1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:45:06.664693 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:45:07.018218 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] restoring object. backup: 0ea5ca0d-7367-454b-a631-0d9f828db381, container: volumebackups, object name: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00014, volume: 96d864fe-0e62-42dc-8da3-1e262ff640e1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:45:07.035673 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:45:07.375148 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] restoring object. backup: 0ea5ca0d-7367-454b-a631-0d9f828db381, container: volumebackups, object name: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00015, volume: 96d864fe-0e62-42dc-8da3-1e262ff640e1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:45:07.401824 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:45:07.748597 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] restoring object. backup: 0ea5ca0d-7367-454b-a631-0d9f828db381, container: volumebackups, object name: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00016, volume: 96d864fe-0e62-42dc-8da3-1e262ff640e1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:45:07.767325 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:45:08.112036 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] restoring object. backup: 0ea5ca0d-7367-454b-a631-0d9f828db381, container: volumebackups, object name: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00017, volume: 96d864fe-0e62-42dc-8da3-1e262ff640e1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:45:08.130147 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:45:08.485390 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] restoring object. backup: 0ea5ca0d-7367-454b-a631-0d9f828db381, container: volumebackups, object name: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00018, volume: 96d864fe-0e62-42dc-8da3-1e262ff640e1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:45:08.515789 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:45:08.875186 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] restoring object. backup: 0ea5ca0d-7367-454b-a631-0d9f828db381, container: volumebackups, object name: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00019, volume: 96d864fe-0e62-42dc-8da3-1e262ff640e1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:45:08.889908 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:45:09.232040 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] restoring object. backup: 0ea5ca0d-7367-454b-a631-0d9f828db381, container: volumebackups, object name: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00020, volume: 96d864fe-0e62-42dc-8da3-1e262ff640e1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:45:09.246100 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:45:09.568379 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] restoring object. backup: 0ea5ca0d-7367-454b-a631-0d9f828db381, container: volumebackups, object name: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00021, volume: 96d864fe-0e62-42dc-8da3-1e262ff640e1. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:45:09.585261 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:45:09.741918 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] v1 volume backup restore of 0ea5ca0d-7367-454b-a631-0d9f828db381 finished. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 05 03:45:09.742176 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Restoring volume base metadata {{(pid=101413) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 05 03:45:09.748033 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Excluding field 'display_name' {{(pid=101413) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 05 03:45:09.748179 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Excluding field 'display_description' {{(pid=101413) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 05 03:45:09.754595 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] No metadata of type 'volume-metadata' to restore {{(pid=101413) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 05 03:45:09.754888 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=101413) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 05 03:45:09.755096 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] restore 0ea5ca0d-7367-454b-a631-0d9f828db381 to 96d864fe-0e62-42dc-8da3-1e262ff640e1 finished. {{(pid=101413) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jul 05 03:45:09.755596 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:45:09.775460 np0000004562 sudo[148048]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde Jul 05 03:45:09.776095 np0000004562 sudo[148048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:45:10.157115 np0000004562 sudo[148048]: pam_unix(sudo:session): session closed for user root Jul 05 03:45:10.159321 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde" returned: 0 in 0.403s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:45:10.159982 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96d864fe-0e62-42dc-8da3-1e262ff640e1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96d864fe-0e62-42dc-8da3-1e262ff640e1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799173', 'path': '/dev/sde'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:45:10.160295 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:45:10.160901 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:45:10.161449 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96d864fe-0e62-42dc-8da3-1e262ff640e1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96d864fe-0e62-42dc-8da3-1e262ff640e1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:45:10.172466 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:45:10.172466 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:45:10.172466 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:45:10.172466 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:45:10.172466 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:45:10.172466 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-96d864fe-0e62-42dc-8da3-1e262ff640e1 Jul 05 03:45:10.172466 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:45:10.172466 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:45:10.172466 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-02fb9bb6-f74a-4cd7-be7c-235e04e842d7 Jul 05 03:45:10.172466 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:45:10.172466 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:45:10.172466 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:45:10.172466 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:45:10.172466 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:45:10.172466 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:45:10.172466 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:45:10.172857 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:45:10.172857 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:45:10.172857 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:45:10.173065 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96d864fe-0e62-42dc-8da3-1e262ff640e1', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:45:10.198509 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02fb9bb6-f74a-4cd7-be7c-235e04e842d7 (non-flash) Jul 05 03:45:10.198509 np0000004562 cinder-backup[101413]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02fb9bb6-f74a-4cd7-be7c-235e04e842d7 (non-flash) Jul 05 03:45:10.198509 np0000004562 cinder-backup[101413]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d864fe-0e62-42dc-8da3-1e262ff640e1 (non-flash) Jul 05 03:45:10.198509 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:45:10.198749 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02fb9bb6-f74a-4cd7-be7c-235e04e842d7 (non-flash) Jul 05 03:45:10.198749 np0000004562 cinder-backup[101413]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02fb9bb6-f74a-4cd7-be7c-235e04e842d7 (non-flash) Jul 05 03:45:10.198749 np0000004562 cinder-backup[101413]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96d864fe-0e62-42dc-8da3-1e262ff640e1 (non-flash) Jul 05 03:45:10.198749 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:45:10.198997 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-02fb9bb6-f74a-4cd7-be7c-235e04e842d7', '175'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-02fb9bb6-f74a-4cd7-be7c-235e04e842d7', '176'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96d864fe-0e62-42dc-8da3-1e262ff640e1', '177')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:45:10.199246 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-96d864fe-0e62-42dc-8da3-1e262ff640e1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96d864fe-0e62-42dc-8da3-1e262ff640e1', '177')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:45:10.200134 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Resulting device map defaultdict(. at 0x72a48e94c7c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96d864fe-0e62-42dc-8da3-1e262ff640e1'): ({'sde'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:45:10.200403 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Removing single pathed devices sde {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:45:10.211944 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Flushing IO for device /dev/sde {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:45:10.220213 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:45:10.268769 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Checking to see if SCSI volumes sde have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:45:10.268981 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] SCSI volumes sde have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:45:10.270093 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Checking to see if device paths {'sde'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:45:10.281768 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Device paths {'sde'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:45:10.282045 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96d864fe-0e62-42dc-8da3-1e262ff640e1')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:45:10.292466 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:45:10.327445 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 177, target: iqn.2023-03.storpool.com:os--volume-96d864fe-0e62-42dc-8da3-1e262ff640e1, portal: 192.168.40.100,3260] Jul 05 03:45:10.327445 np0000004562 cinder-backup[101413]: Logout of [sid: 177, target: iqn.2023-03.storpool.com:os--volume-96d864fe-0e62-42dc-8da3-1e262ff640e1, portal: 192.168.40.100,3260] successful. Jul 05 03:45:10.327445 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:45:10.339481 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:45:10.339806 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.179s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:45:10.339945 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] <== disconnect_volume: return (180ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:45:11.351445 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.manager [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Encryption key ID for volume 96d864fe-0e62-42dc-8da3-1e262ff640e1 already matches encryption key ID in backup 0ea5ca0d-7367-454b-a631-0d9f828db381. {{(pid=101413) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jul 05 03:45:11.368733 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-5b741300-6423-48ab-a526-9e230b9d5ac9 tempest-ProjectAdminTests33-657181126 None] Finished restoring backup 0ea5ca0d-7367-454b-a631-0d9f828db381 to volume 96d864fe-0e62-42dc-8da3-1e262ff640e1. Jul 05 03:45:11.787679 np0000004562 cinder-backup[101413]: DEBUG oslo_service.periodic_task [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:45:11.787955 np0000004562 cinder-backup[101413]: DEBUG cinder.manager [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Notifying Schedulers of capabilities ... {{(pid=101413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:45:13.438627 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-28d351c6-b2fe-402e-9368-bbc60ecb8520 tempest-ProjectAdminTests33-657181126 None] Delete backup started, backup: 6b8d1752-fa56-4bca-8f2a-2bd74befe0e4. Jul 05 03:45:13.446104 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-28d351c6-b2fe-402e-9368-bbc60ecb8520 tempest-ProjectAdminTests33-657181126 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_4891f452f0954ca2ab42df311c6d7f91 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:45:13.446470 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-28d351c6-b2fe-402e-9368-bbc60ecb8520 tempest-ProjectAdminTests33-657181126 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:45:13.446687 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-28d351c6-b2fe-402e-9368-bbc60ecb8520 tempest-ProjectAdminTests33-657181126 None] delete started, backup: 6b8d1752-fa56-4bca-8f2a-2bd74befe0e4, container: volumebackups, prefix: volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:45:13.480501 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-28d351c6-b2fe-402e-9368-bbc60ecb8520 tempest-ProjectAdminTests33-657181126 None] generated object list: ['volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00001', 'volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00002', 'volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00003', 'volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00004', 'volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00005', 'volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00006', 'volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00007', 'volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00008', 'volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00009', 'volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00010', 'volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00011', 'volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00012', 'volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00013', 'volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00014', 'volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00015', 'volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00016', 'volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00017', 'volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00018', 'volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00019', 'volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00020', 'volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00021', 'volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4_metadata', 'volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:45:13.499871 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-28d351c6-b2fe-402e-9368-bbc60ecb8520 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00001 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:13.517355 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-28d351c6-b2fe-402e-9368-bbc60ecb8520 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00002 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:13.533929 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-28d351c6-b2fe-402e-9368-bbc60ecb8520 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00003 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:13.552123 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-28d351c6-b2fe-402e-9368-bbc60ecb8520 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00004 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:13.569704 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-28d351c6-b2fe-402e-9368-bbc60ecb8520 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00005 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:13.591699 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-28d351c6-b2fe-402e-9368-bbc60ecb8520 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00006 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:13.613971 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-28d351c6-b2fe-402e-9368-bbc60ecb8520 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00007 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:13.634262 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-28d351c6-b2fe-402e-9368-bbc60ecb8520 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00008 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:13.652280 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-28d351c6-b2fe-402e-9368-bbc60ecb8520 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00009 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:13.671882 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-28d351c6-b2fe-402e-9368-bbc60ecb8520 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00010 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:13.692851 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-28d351c6-b2fe-402e-9368-bbc60ecb8520 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00011 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:13.713308 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-28d351c6-b2fe-402e-9368-bbc60ecb8520 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00012 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:13.736229 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-28d351c6-b2fe-402e-9368-bbc60ecb8520 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00013 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:13.756944 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-28d351c6-b2fe-402e-9368-bbc60ecb8520 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00014 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:13.776100 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-28d351c6-b2fe-402e-9368-bbc60ecb8520 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00015 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:13.795695 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-28d351c6-b2fe-402e-9368-bbc60ecb8520 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00016 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:13.813902 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-28d351c6-b2fe-402e-9368-bbc60ecb8520 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00017 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:13.830613 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-28d351c6-b2fe-402e-9368-bbc60ecb8520 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00018 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:13.847565 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-28d351c6-b2fe-402e-9368-bbc60ecb8520 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00019 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:13.865494 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-28d351c6-b2fe-402e-9368-bbc60ecb8520 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00020 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:13.883831 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-28d351c6-b2fe-402e-9368-bbc60ecb8520 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4-00021 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:13.904611 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-28d351c6-b2fe-402e-9368-bbc60ecb8520 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4_metadata in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:13.927009 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-28d351c6-b2fe-402e-9368-bbc60ecb8520 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_f9dd5002-8047-4f56-a4b9-b9f31bbe33fb/20260705034441/az_nova_backup_6b8d1752-fa56-4bca-8f2a-2bd74befe0e4_sha256file in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:13.927288 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-28d351c6-b2fe-402e-9368-bbc60ecb8520 tempest-ProjectAdminTests33-657181126 None] delete 6b8d1752-fa56-4bca-8f2a-2bd74befe0e4 finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:45:13.961698 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-28d351c6-b2fe-402e-9368-bbc60ecb8520 tempest-ProjectAdminTests33-657181126 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:45:13.976889 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-28d351c6-b2fe-402e-9368-bbc60ecb8520 tempest-ProjectAdminTests33-657181126 None] Created reservations ['9864e6c8-ca5b-4506-b73b-abb3a1ff06a8', 'b4d3f52c-f761-4966-8e10-1fadf0c10b2d'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:45:13.992213 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-28d351c6-b2fe-402e-9368-bbc60ecb8520 tempest-ProjectAdminTests33-657181126 None] Delete backup finished, backup 6b8d1752-fa56-4bca-8f2a-2bd74befe0e4 deleted. Jul 05 03:45:14.504048 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-4cfdcbda-9705-4241-9d0e-d4a2d3c314dc tempest-ProjectAdminTests33-657181126 None] Delete backup started, backup: 53d82340-eb05-4fa9-956a-a14a2b2cc920. Jul 05 03:45:14.506938 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-4cfdcbda-9705-4241-9d0e-d4a2d3c314dc tempest-ProjectAdminTests33-657181126 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_4891f452f0954ca2ab42df311c6d7f91 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:45:14.507131 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-4cfdcbda-9705-4241-9d0e-d4a2d3c314dc tempest-ProjectAdminTests33-657181126 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:45:14.507650 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4cfdcbda-9705-4241-9d0e-d4a2d3c314dc tempest-ProjectAdminTests33-657181126 None] delete started, backup: 53d82340-eb05-4fa9-956a-a14a2b2cc920, container: volumebackups, prefix: volume_4a43ea89-da69-4ba0-95d2-91d6607b4ac0/20260705034418/az_nova_backup_53d82340-eb05-4fa9-956a-a14a2b2cc920. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:45:14.532651 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4cfdcbda-9705-4241-9d0e-d4a2d3c314dc tempest-ProjectAdminTests33-657181126 None] generated object list: []. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:45:14.532828 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-4cfdcbda-9705-4241-9d0e-d4a2d3c314dc tempest-ProjectAdminTests33-657181126 None] delete 53d82340-eb05-4fa9-956a-a14a2b2cc920 finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:45:14.565521 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-4cfdcbda-9705-4241-9d0e-d4a2d3c314dc tempest-ProjectAdminTests33-657181126 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:45:14.579252 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-4cfdcbda-9705-4241-9d0e-d4a2d3c314dc tempest-ProjectAdminTests33-657181126 None] Created reservations ['92b9a0df-4f29-4724-8a9c-2cd0544e31d2', '0919ec23-8f5d-49b4-8f18-9e54f4c6c7c6'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:45:14.594993 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-4cfdcbda-9705-4241-9d0e-d4a2d3c314dc tempest-ProjectAdminTests33-657181126 None] Delete backup finished, backup 53d82340-eb05-4fa9-956a-a14a2b2cc920 deleted. Jul 05 03:45:15.586795 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-31a43021-4809-469f-8281-a27f05c3b3b7 tempest-ProjectAdminTests33-657181126 None] Delete backup started, backup: 0ea5ca0d-7367-454b-a631-0d9f828db381. Jul 05 03:45:15.591609 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-31a43021-4809-469f-8281-a27f05c3b3b7 tempest-ProjectAdminTests33-657181126 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_4891f452f0954ca2ab42df311c6d7f91 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:45:15.594004 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-31a43021-4809-469f-8281-a27f05c3b3b7 tempest-ProjectAdminTests33-657181126 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:45:15.594004 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-31a43021-4809-469f-8281-a27f05c3b3b7 tempest-ProjectAdminTests33-657181126 None] delete started, backup: 0ea5ca0d-7367-454b-a631-0d9f828db381, container: volumebackups, prefix: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:45:15.634553 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-31a43021-4809-469f-8281-a27f05c3b3b7 tempest-ProjectAdminTests33-657181126 None] generated object list: ['volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00001', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00002', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00003', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00004', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00005', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00006', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00007', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00008', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00009', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00010', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00011', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00012', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00013', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00014', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00015', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00016', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00017', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00018', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00019', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00020', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00021', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381_metadata', 'volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:45:15.655169 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-31a43021-4809-469f-8281-a27f05c3b3b7 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00001 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:15.687780 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-31a43021-4809-469f-8281-a27f05c3b3b7 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00002 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:15.709055 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-31a43021-4809-469f-8281-a27f05c3b3b7 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00003 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:15.728613 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-31a43021-4809-469f-8281-a27f05c3b3b7 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00004 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:15.750032 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-31a43021-4809-469f-8281-a27f05c3b3b7 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00005 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:15.773091 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-31a43021-4809-469f-8281-a27f05c3b3b7 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00006 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:15.795170 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-31a43021-4809-469f-8281-a27f05c3b3b7 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00007 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:15.823204 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-31a43021-4809-469f-8281-a27f05c3b3b7 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00008 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:15.844749 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-31a43021-4809-469f-8281-a27f05c3b3b7 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00009 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:15.876104 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-31a43021-4809-469f-8281-a27f05c3b3b7 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00010 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:15.897900 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-31a43021-4809-469f-8281-a27f05c3b3b7 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00011 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:15.921015 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-31a43021-4809-469f-8281-a27f05c3b3b7 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00012 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:15.962971 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-31a43021-4809-469f-8281-a27f05c3b3b7 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00013 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:15.986023 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-31a43021-4809-469f-8281-a27f05c3b3b7 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00014 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:16.008825 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-31a43021-4809-469f-8281-a27f05c3b3b7 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00015 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:16.035739 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-31a43021-4809-469f-8281-a27f05c3b3b7 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00016 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:16.061960 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-31a43021-4809-469f-8281-a27f05c3b3b7 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00017 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:16.087902 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-31a43021-4809-469f-8281-a27f05c3b3b7 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00018 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:16.108386 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-31a43021-4809-469f-8281-a27f05c3b3b7 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00019 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:16.127284 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-31a43021-4809-469f-8281-a27f05c3b3b7 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00020 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:16.145725 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-31a43021-4809-469f-8281-a27f05c3b3b7 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381-00021 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:16.165089 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-31a43021-4809-469f-8281-a27f05c3b3b7 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381_metadata in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:16.185228 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-31a43021-4809-469f-8281-a27f05c3b3b7 tempest-ProjectAdminTests33-657181126 None] deleted object: volume_98295ac8-1979-4056-8a5b-bb5d71f20e92/20260705034316/az_nova_backup_0ea5ca0d-7367-454b-a631-0d9f828db381_sha256file in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:16.185437 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-31a43021-4809-469f-8281-a27f05c3b3b7 tempest-ProjectAdminTests33-657181126 None] delete 0ea5ca0d-7367-454b-a631-0d9f828db381 finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:45:16.235817 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-31a43021-4809-469f-8281-a27f05c3b3b7 tempest-ProjectAdminTests33-657181126 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:45:16.248921 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-31a43021-4809-469f-8281-a27f05c3b3b7 tempest-ProjectAdminTests33-657181126 None] Created reservations ['9fd6436f-d059-49d5-a5e4-c95d18fb5b25', 'a720efd1-4202-4d13-839e-6b43d488017c'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:45:16.266481 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-31a43021-4809-469f-8281-a27f05c3b3b7 tempest-ProjectAdminTests33-657181126 None] Delete backup finished, backup 0ea5ca0d-7367-454b-a631-0d9f828db381 deleted. Jul 05 03:45:26.261951 np0000004562 cinder-backup[101413]: DEBUG dbcounter [-] [101413] Writing DB stats cinder:SELECT=41,cinder:UPDATE=21,cinder:INSERT=7 {{(pid=101413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:45:34.567733 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Create backup started, backup: 56651bfe-9ae7-4672-af13-517b9f7936f5 volume: c379499f-2909-4630-a615-a3c64826bd2f. Jul 05 03:45:34.572828 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T03:45:34Z,data_timestamp=2026-07-05T03:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-1570097794',encryption_key_id=None,fail_reason=None,host='np0000004562',id=56651bfe-9ae7-4672-af13-517b9f7936f5,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='cc31f78be9de480996fd788382c337f6',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='36e5811facc04d4b9bcae4d934fddbc8',volume_id=c379499f-2909-4630-a615-a3c64826bd2f) Jul 05 03:45:34.608833 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_cc31f78be9de480996fd788382c337f6 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:45:34.609110 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:45:34.609417 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:45:34.618871 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:45:34.637815 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:45:34.653019 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:45:34.653361 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:45:34.662315 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:45:34.663643 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe3a:c685', 'fe80::80e7:33ff:fe1d:273b', 'fe80::f816:3eff:fe28:c9a9', 'fe80::a82c:edff:fe00:fc0a', 'fe80::f816:3eff:fef2:fa4b', 'fe80::e477:baff:fee9:cab5'] Jul 05 03:45:34.663774 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:45:34.663903 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:45:34.664149 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] <== get_connector_properties: return (54ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:45:35.167880 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:45:35.168357 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c379499f-2909-4630-a615-a3c64826bd2f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c379499f-2909-4630-a615-a3c64826bd2f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:45:35.168581 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:45:35.169091 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:45:35.169366 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c379499f-2909-4630-a615-a3c64826bd2f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c379499f-2909-4630-a615-a3c64826bd2f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:45:35.179466 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c379499f-2909-4630-a615-a3c64826bd2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:45:35.179961 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c379499f-2909-4630-a615-a3c64826bd2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:45:35.180166 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:45:35.191273 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:45:35.191273 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:45:35.201864 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c379499f-2909-4630-a615-a3c64826bd2f] added Jul 05 03:45:35.201864 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:45:35.201864 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:45:35.201864 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:45:35.201864 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:45:35.201864 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:45:35.201864 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:45:35.201864 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:45:35.202302 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0219(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:45:35.202657 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:45:36.203956 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-c379499f-2909-4630-a615-a3c64826bd2f Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:45:36.217137 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:45:36.227671 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:45:36.244503 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02fb9bb6-f74a-4cd7-be7c-235e04e842d7 (non-flash) Jul 05 03:45:36.244503 np0000004562 cinder-backup[101413]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02fb9bb6-f74a-4cd7-be7c-235e04e842d7 (non-flash) Jul 05 03:45:36.244503 np0000004562 cinder-backup[101413]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a02f6f1-fde5-40fc-8755-90424c5bd71a (non-flash) Jul 05 03:45:36.244503 np0000004562 cinder-backup[101413]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a02f6f1-fde5-40fc-8755-90424c5bd71a (non-flash) Jul 05 03:45:36.244503 np0000004562 cinder-backup[101413]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-632e19fe-72e9-44e5-a809-a8fbd34b5e86 (non-flash) Jul 05 03:45:36.244503 np0000004562 cinder-backup[101413]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-632e19fe-72e9-44e5-a809-a8fbd34b5e86 (non-flash) Jul 05 03:45:36.244503 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:45:36.244867 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02fb9bb6-f74a-4cd7-be7c-235e04e842d7 (non-flash) Jul 05 03:45:36.244867 np0000004562 cinder-backup[101413]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02fb9bb6-f74a-4cd7-be7c-235e04e842d7 (non-flash) Jul 05 03:45:36.244867 np0000004562 cinder-backup[101413]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a02f6f1-fde5-40fc-8755-90424c5bd71a (non-flash) Jul 05 03:45:36.244867 np0000004562 cinder-backup[101413]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a02f6f1-fde5-40fc-8755-90424c5bd71a (non-flash) Jul 05 03:45:36.244867 np0000004562 cinder-backup[101413]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-632e19fe-72e9-44e5-a809-a8fbd34b5e86 (non-flash) Jul 05 03:45:36.244867 np0000004562 cinder-backup[101413]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-632e19fe-72e9-44e5-a809-a8fbd34b5e86 (non-flash) Jul 05 03:45:36.244867 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:45:36.280087 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c379499f-2909-4630-a615-a3c64826bd2f, portal: 192.168.40.100,3260] Jul 05 03:45:36.280087 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c379499f-2909-4630-a615-a3c64826bd2f, portal: 192.168.40.100,3260] successful. Jul 05 03:45:36.280087 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:45:36.291550 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:45:36.307305 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02fb9bb6-f74a-4cd7-be7c-235e04e842d7 (non-flash) Jul 05 03:45:36.307305 np0000004562 cinder-backup[101413]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02fb9bb6-f74a-4cd7-be7c-235e04e842d7 (non-flash) Jul 05 03:45:36.307305 np0000004562 cinder-backup[101413]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a02f6f1-fde5-40fc-8755-90424c5bd71a (non-flash) Jul 05 03:45:36.307305 np0000004562 cinder-backup[101413]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a02f6f1-fde5-40fc-8755-90424c5bd71a (non-flash) Jul 05 03:45:36.307305 np0000004562 cinder-backup[101413]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-632e19fe-72e9-44e5-a809-a8fbd34b5e86 (non-flash) Jul 05 03:45:36.307305 np0000004562 cinder-backup[101413]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-632e19fe-72e9-44e5-a809-a8fbd34b5e86 (non-flash) Jul 05 03:45:36.307305 np0000004562 cinder-backup[101413]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c379499f-2909-4630-a615-a3c64826bd2f (non-flash) Jul 05 03:45:36.307305 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:45:36.307691 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02fb9bb6-f74a-4cd7-be7c-235e04e842d7 (non-flash) Jul 05 03:45:36.307691 np0000004562 cinder-backup[101413]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02fb9bb6-f74a-4cd7-be7c-235e04e842d7 (non-flash) Jul 05 03:45:36.307691 np0000004562 cinder-backup[101413]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a02f6f1-fde5-40fc-8755-90424c5bd71a (non-flash) Jul 05 03:45:36.307691 np0000004562 cinder-backup[101413]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a02f6f1-fde5-40fc-8755-90424c5bd71a (non-flash) Jul 05 03:45:36.307691 np0000004562 cinder-backup[101413]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-632e19fe-72e9-44e5-a809-a8fbd34b5e86 (non-flash) Jul 05 03:45:36.307691 np0000004562 cinder-backup[101413]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-632e19fe-72e9-44e5-a809-a8fbd34b5e86 (non-flash) Jul 05 03:45:36.307691 np0000004562 cinder-backup[101413]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c379499f-2909-4630-a615-a3c64826bd2f (non-flash) Jul 05 03:45:36.307691 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:45:36.307907 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c379499f-2909-4630-a615-a3c64826bd2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.128s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:45:36.307907 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:45:36.308734 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] HCTL ('13', '-', '-', 0) found on session 182 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:45:36.308848 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Scanning host 13 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:45:36.325810 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Searching for a device in session 182 and hctl ['13', '*', '*', 0] yield: None {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:45:37.324801 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Searching for a device in session 182 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:45:37.325358 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c379499f-2909-4630-a615-a3c64826bd2f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c379499f-2909-4630-a615-a3c64826bd2f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:45:37.325666 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.157s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:45:37.325883 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] <== connect_volume: return (2157ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799184', 'path': '/dev/sdh'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:45:37.326233 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:45:37.343390 np0000004562 sudo[148549]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh Jul 05 03:45:37.343997 np0000004562 sudo[148549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:45:37.649314 np0000004562 sudo[148549]: pam_unix(sudo:session): session closed for user root Jul 05 03:45:37.651517 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh" returned: 0 in 0.325s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:45:37.692192 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:45:37.698381 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] _create_container started, container: volumebackups,backup: 56651bfe-9ae7-4672-af13-517b9f7936f5. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:45:37.818377 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] generate_object_name_prefix: volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5 {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:45:37.823254 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] starting backup of volume: c379499f-2909-4630-a615-a3c64826bd2f, volume size: 1073741824, object names prefix volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:45:38.004300 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:45:38.250412 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:45:38.250637 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:45:38.353307 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] backup MD5 for volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:45:38.353759 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:45:38.530616 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:45:38.783043 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:45:38.783351 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:45:38.882021 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] backup MD5 for volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:45:38.882364 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:45:39.072761 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:45:39.330472 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:45:39.330670 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:45:39.426186 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] backup MD5 for volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:45:39.426549 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:45:39.601438 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:45:39.851528 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:45:39.851784 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:45:39.952884 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] backup MD5 for volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:45:39.953022 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:45:40.129471 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:45:40.380019 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:45:40.380164 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:45:40.478200 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] backup MD5 for volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:45:40.478690 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:45:40.660667 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:45:40.907385 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:45:40.907509 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:45:41.009706 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] backup MD5 for volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:45:41.009870 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:45:41.190818 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:45:41.428671 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:45:41.428824 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:45:41.526686 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] backup MD5 for volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:45:41.526686 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:45:41.741133 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:45:41.981610 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:45:41.981744 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:45:42.078306 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] backup MD5 for volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:45:42.078412 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:45:42.261300 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:45:42.506786 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:45:42.506923 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:45:42.605147 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] backup MD5 for volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:45:42.605531 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:45:42.787621 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:45:43.032010 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:45:43.032415 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:45:43.143682 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] backup MD5 for volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:45:43.143682 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:45:43.326481 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:45:43.567938 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:45:43.568093 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:45:43.667331 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] backup MD5 for volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:45:43.667793 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:45:43.882798 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:45:44.127317 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:45:44.127468 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:45:44.231108 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] backup MD5 for volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:45:44.231283 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:45:44.404007 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:45:44.667683 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:45:44.668108 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:45:44.777021 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] backup MD5 for volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:45:44.777755 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:45:44.954207 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:45:45.209924 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:45:45.212801 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:45:45.316961 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] backup MD5 for volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:45:45.317147 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:45:45.520541 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:45:45.774459 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:45:45.774952 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:45:45.879209 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] backup MD5 for volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:45:45.879355 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:45:46.063475 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:45:46.313906 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:45:46.314131 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:45:46.421649 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] backup MD5 for volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:45:46.421799 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:45:46.643655 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:45:46.891745 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:45:46.892030 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:45:47.003824 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] backup MD5 for volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:45:47.003952 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:45:47.220548 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:45:47.468098 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:45:47.468098 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:45:47.593285 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] backup MD5 for volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:45:47.593285 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:45:47.833305 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:45:48.116191 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:45:48.116626 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:45:48.235920 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] backup MD5 for volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:45:48.235920 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:45:48.445377 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:45:48.688117 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:45:48.688239 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:45:48.790700 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] backup MD5 for volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:45:48.790890 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:45:48.899272 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:45:49.018211 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:45:49.018373 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:45:49.081367 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] backup MD5 for volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:45:49.081367 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:45:49.090475 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:45:49.095656 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:45:49.095857 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:45:49.099414 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:45:49.099547 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:45:49.102162 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:45:49.102387 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:45:49.157970 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:45:49.158736 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] _write_metadata started, container name: volumebackups, metadata filename: volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:45:49.185412 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "56651bfe-9ae7-4672-af13-517b9f7936f5",\n "backup_name": "tempest-type-Backup-1570097794",\n "created_at": "2026-07-05 03:45:35+00:00",\n "objects": [\n {\n "volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "c379499f-2909-4630-a615-a3c64826bd2f",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"c379499f-2909-4630-a615-a3c64826bd2f\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"36e5811facc04d4b9bcae4d934fddbc8\\", \\"project_id\\": \\"cc31f78be9de480996fd788382c337f6\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:45:33.000000\\", \\"launched_at\\": \\"2026-07-05T03:45:34.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1393433579\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:45:33.000000\\", \\"updated_at\\": \\"2026-07-05T03:45:35.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:45:49.191544 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] backup 56651bfe-9ae7-4672-af13-517b9f7936f5 finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:45:49.326397 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:45:49.348297 np0000004562 sudo[149030]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh Jul 05 03:45:49.349140 np0000004562 sudo[149030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:45:49.637908 np0000004562 sudo[149030]: pam_unix(sudo:session): session closed for user root Jul 05 03:45:49.639861 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh" returned: 0 in 0.313s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:45:49.640456 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c379499f-2909-4630-a615-a3c64826bd2f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c379499f-2909-4630-a615-a3c64826bd2f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799184', 'path': '/dev/sdh'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:45:49.640640 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:45:49.641124 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:45:49.641505 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c379499f-2909-4630-a615-a3c64826bd2f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c379499f-2909-4630-a615-a3c64826bd2f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:45:49.652695 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:45:49.652695 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:45:49.652695 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:45:49.652695 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:45:49.652695 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:45:49.652695 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-c379499f-2909-4630-a615-a3c64826bd2f Jul 05 03:45:49.652695 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:45:49.652695 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:45:49.652695 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-be3b26a7-9e69-4425-85f3-727f6b4ad2e3 Jul 05 03:45:49.652695 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:45:49.652695 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:45:49.652695 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:45:49.652695 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:45:49.652695 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-02fb9bb6-f74a-4cd7-be7c-235e04e842d7 Jul 05 03:45:49.652695 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:45:49.652695 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:45:49.652695 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:45:49.652695 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:45:49.652695 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:45:49.652695 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:45:49.652695 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:45:49.653401 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:45:49.653401 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:45:49.653401 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:45:49.653401 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c379499f-2909-4630-a615-a3c64826bd2f', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:45:49.678726 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02fb9bb6-f74a-4cd7-be7c-235e04e842d7 (non-flash) Jul 05 03:45:49.678726 np0000004562 cinder-backup[101413]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02fb9bb6-f74a-4cd7-be7c-235e04e842d7 (non-flash) Jul 05 03:45:49.678726 np0000004562 cinder-backup[101413]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c379499f-2909-4630-a615-a3c64826bd2f (non-flash) Jul 05 03:45:49.678726 np0000004562 cinder-backup[101413]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be3b26a7-9e69-4425-85f3-727f6b4ad2e3 (non-flash) Jul 05 03:45:49.678726 np0000004562 cinder-backup[101413]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be3b26a7-9e69-4425-85f3-727f6b4ad2e3 (non-flash) Jul 05 03:45:49.678726 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:45:49.678965 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02fb9bb6-f74a-4cd7-be7c-235e04e842d7 (non-flash) Jul 05 03:45:49.678965 np0000004562 cinder-backup[101413]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02fb9bb6-f74a-4cd7-be7c-235e04e842d7 (non-flash) Jul 05 03:45:49.678965 np0000004562 cinder-backup[101413]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c379499f-2909-4630-a615-a3c64826bd2f (non-flash) Jul 05 03:45:49.678965 np0000004562 cinder-backup[101413]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be3b26a7-9e69-4425-85f3-727f6b4ad2e3 (non-flash) Jul 05 03:45:49.678965 np0000004562 cinder-backup[101413]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be3b26a7-9e69-4425-85f3-727f6b4ad2e3 (non-flash) Jul 05 03:45:49.678965 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:45:49.679245 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-02fb9bb6-f74a-4cd7-be7c-235e04e842d7', '175'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-02fb9bb6-f74a-4cd7-be7c-235e04e842d7', '176'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c379499f-2909-4630-a615-a3c64826bd2f', '182'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-be3b26a7-9e69-4425-85f3-727f6b4ad2e3', '183'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-be3b26a7-9e69-4425-85f3-727f6b4ad2e3', '184')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:45:49.679461 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c379499f-2909-4630-a615-a3c64826bd2f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c379499f-2909-4630-a615-a3c64826bd2f', '182')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:45:49.680776 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Resulting device map defaultdict(. at 0x72a46fdd7ba0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c379499f-2909-4630-a615-a3c64826bd2f'): ({'sdh'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:45:49.681072 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Removing single pathed devices sdh {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:45:49.692351 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Flushing IO for device /dev/sdh {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:45:49.700621 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:45:49.745151 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Checking to see if SCSI volumes sdh have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:45:49.745374 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] SCSI volumes sdh have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:45:49.746847 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Checking to see if device paths {'sdh'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:45:49.757785 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Device paths {'sdh'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:45:49.758323 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c379499f-2909-4630-a615-a3c64826bd2f')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:45:49.769071 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:45:49.803999 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 182, target: iqn.2023-03.storpool.com:os--volume-c379499f-2909-4630-a615-a3c64826bd2f, portal: 192.168.40.100,3260] Jul 05 03:45:49.803999 np0000004562 cinder-backup[101413]: Logout of [sid: 182, target: iqn.2023-03.storpool.com:os--volume-c379499f-2909-4630-a615-a3c64826bd2f, portal: 192.168.40.100,3260] successful. Jul 05 03:45:49.803999 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:45:49.820627 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:45:49.820935 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.180s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:45:49.821107 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] <== disconnect_volume: return (180ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:45:50.839422 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-3ec51fa0-8dfd-44bb-8bab-39d6c2b41f17 tempest-ProjectAdminTests39-1446704734 None] Create backup finished. backup: 56651bfe-9ae7-4672-af13-517b9f7936f5. Jul 05 03:45:50.963436 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-201057ca-6929-4e69-8bf8-f064d71dc442 tempest-ProjectAdminTests39-1446704734 None] Delete backup started, backup: 56651bfe-9ae7-4672-af13-517b9f7936f5. Jul 05 03:45:50.969487 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-201057ca-6929-4e69-8bf8-f064d71dc442 tempest-ProjectAdminTests39-1446704734 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_cc31f78be9de480996fd788382c337f6 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:45:50.969687 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-201057ca-6929-4e69-8bf8-f064d71dc442 tempest-ProjectAdminTests39-1446704734 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:45:50.969861 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-201057ca-6929-4e69-8bf8-f064d71dc442 tempest-ProjectAdminTests39-1446704734 None] delete started, backup: 56651bfe-9ae7-4672-af13-517b9f7936f5, container: volumebackups, prefix: volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:45:51.016346 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-201057ca-6929-4e69-8bf8-f064d71dc442 tempest-ProjectAdminTests39-1446704734 None] generated object list: ['volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00001', 'volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00002', 'volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00003', 'volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00004', 'volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00005', 'volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00006', 'volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00007', 'volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00008', 'volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00009', 'volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00010', 'volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00011', 'volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00012', 'volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00013', 'volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00014', 'volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00015', 'volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00016', 'volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00017', 'volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00018', 'volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00019', 'volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00020', 'volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00021', 'volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5_metadata', 'volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:45:51.038643 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-201057ca-6929-4e69-8bf8-f064d71dc442 tempest-ProjectAdminTests39-1446704734 None] deleted object: volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00001 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:51.058671 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-201057ca-6929-4e69-8bf8-f064d71dc442 tempest-ProjectAdminTests39-1446704734 None] deleted object: volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00002 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:51.077073 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-201057ca-6929-4e69-8bf8-f064d71dc442 tempest-ProjectAdminTests39-1446704734 None] deleted object: volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00003 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:51.097444 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-201057ca-6929-4e69-8bf8-f064d71dc442 tempest-ProjectAdminTests39-1446704734 None] deleted object: volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00004 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:51.120035 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-201057ca-6929-4e69-8bf8-f064d71dc442 tempest-ProjectAdminTests39-1446704734 None] deleted object: volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00005 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:51.142350 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-201057ca-6929-4e69-8bf8-f064d71dc442 tempest-ProjectAdminTests39-1446704734 None] deleted object: volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00006 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:51.165006 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-201057ca-6929-4e69-8bf8-f064d71dc442 tempest-ProjectAdminTests39-1446704734 None] deleted object: volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00007 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:51.186292 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-201057ca-6929-4e69-8bf8-f064d71dc442 tempest-ProjectAdminTests39-1446704734 None] deleted object: volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00008 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:51.209606 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-201057ca-6929-4e69-8bf8-f064d71dc442 tempest-ProjectAdminTests39-1446704734 None] deleted object: volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00009 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:51.233724 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-201057ca-6929-4e69-8bf8-f064d71dc442 tempest-ProjectAdminTests39-1446704734 None] deleted object: volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00010 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:51.256818 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-201057ca-6929-4e69-8bf8-f064d71dc442 tempest-ProjectAdminTests39-1446704734 None] deleted object: volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00011 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:51.282816 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-201057ca-6929-4e69-8bf8-f064d71dc442 tempest-ProjectAdminTests39-1446704734 None] deleted object: volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00012 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:51.310249 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-201057ca-6929-4e69-8bf8-f064d71dc442 tempest-ProjectAdminTests39-1446704734 None] deleted object: volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00013 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:51.334708 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-201057ca-6929-4e69-8bf8-f064d71dc442 tempest-ProjectAdminTests39-1446704734 None] deleted object: volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00014 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:51.355129 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-201057ca-6929-4e69-8bf8-f064d71dc442 tempest-ProjectAdminTests39-1446704734 None] deleted object: volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00015 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:51.376485 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-201057ca-6929-4e69-8bf8-f064d71dc442 tempest-ProjectAdminTests39-1446704734 None] deleted object: volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00016 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:51.404564 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-201057ca-6929-4e69-8bf8-f064d71dc442 tempest-ProjectAdminTests39-1446704734 None] deleted object: volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00017 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:51.424751 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-201057ca-6929-4e69-8bf8-f064d71dc442 tempest-ProjectAdminTests39-1446704734 None] deleted object: volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00018 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:51.447145 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-201057ca-6929-4e69-8bf8-f064d71dc442 tempest-ProjectAdminTests39-1446704734 None] deleted object: volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00019 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:51.466874 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-201057ca-6929-4e69-8bf8-f064d71dc442 tempest-ProjectAdminTests39-1446704734 None] deleted object: volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00020 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:51.485854 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-201057ca-6929-4e69-8bf8-f064d71dc442 tempest-ProjectAdminTests39-1446704734 None] deleted object: volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5-00021 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:51.504474 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-201057ca-6929-4e69-8bf8-f064d71dc442 tempest-ProjectAdminTests39-1446704734 None] deleted object: volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5_metadata in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:51.523434 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-201057ca-6929-4e69-8bf8-f064d71dc442 tempest-ProjectAdminTests39-1446704734 None] deleted object: volume_c379499f-2909-4630-a615-a3c64826bd2f/20260705034537/az_nova_backup_56651bfe-9ae7-4672-af13-517b9f7936f5_sha256file in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:45:51.523633 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-201057ca-6929-4e69-8bf8-f064d71dc442 tempest-ProjectAdminTests39-1446704734 None] delete 56651bfe-9ae7-4672-af13-517b9f7936f5 finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:45:51.558777 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-201057ca-6929-4e69-8bf8-f064d71dc442 tempest-ProjectAdminTests39-1446704734 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:45:51.579169 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-201057ca-6929-4e69-8bf8-f064d71dc442 tempest-ProjectAdminTests39-1446704734 None] Created reservations ['0a632b88-5670-4e3a-ac60-962dc793d7b0', '59fa5966-bb93-47da-a7b7-e1727754a5e6'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:45:51.592350 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-201057ca-6929-4e69-8bf8-f064d71dc442 tempest-ProjectAdminTests39-1446704734 None] Delete backup finished, backup 56651bfe-9ae7-4672-af13-517b9f7936f5 deleted. Jul 05 03:46:05.755736 np0000004562 cinder-backup[101413]: DEBUG dbcounter [-] [101413] Writing DB stats cinder:SELECT=39,cinder:UPDATE=13,cinder:INSERT=2 {{(pid=101413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:46:11.784488 np0000004562 cinder-backup[101413]: DEBUG oslo_service.periodic_task [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:46:11.785044 np0000004562 cinder-backup[101413]: DEBUG cinder.manager [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Notifying Schedulers of capabilities ... {{(pid=101413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:46:54.367369 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Create backup started, backup: 28bca471-de07-4765-8298-82b3d14218ed volume: b9d14613-adf9-4674-a744-259f8b9d3b8e. Jul 05 03:46:54.380961 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T03:46:54Z,data_timestamp=2026-07-05T03:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromBackupTest-Backup-1522980119',encryption_key_id=None,fail_reason=None,host='np0000004562',id=28bca471-de07-4765-8298-82b3d14218ed,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='9654df19f7c740b284fd07a482320daa',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='c083dbb11f46462c89efe438e3106f61',volume_id=b9d14613-adf9-4674-a744-259f8b9d3b8e) Jul 05 03:46:54.405218 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_9654df19f7c740b284fd07a482320daa {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:46:54.405218 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:46:54.405218 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:46:54.414179 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:46:54.433446 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:46:54.446020 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:46:54.446248 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:46:54.454415 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:46:54.455477 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe28:c9a9', 'fe80::a82c:edff:fe00:fc0a', 'fe80::f816:3eff:fe4e:6e3e', 'fe80::f816:3eff:fe3d:fdcc', 'fe80::d8a1:37ff:feaa:ab63'] Jul 05 03:46:54.455647 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:46:54.455815 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:46:54.456077 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] <== get_connector_properties: return (51ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:46:54.960142 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:46:54.960569 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9d14613-adf9-4674-a744-259f8b9d3b8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9d14613-adf9-4674-a744-259f8b9d3b8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:46:54.960788 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:46:54.961326 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:46:54.961591 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9d14613-adf9-4674-a744-259f8b9d3b8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9d14613-adf9-4674-a744-259f8b9d3b8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:46:54.972009 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b9d14613-adf9-4674-a744-259f8b9d3b8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:46:54.972439 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b9d14613-adf9-4674-a744-259f8b9d3b8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:46:54.972678 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:46:54.981982 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:46:54.981982 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:46:54.992225 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b9d14613-adf9-4674-a744-259f8b9d3b8e] added Jul 05 03:46:54.992225 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:46:54.992225 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:46:54.992225 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:46:54.992225 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:46:54.992225 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:46:54.992225 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:46:54.992443 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:46:54.992904 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0201(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:46:54.993142 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:46:55.994552 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-b9d14613-adf9-4674-a744-259f8b9d3b8e Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:46:56.004194 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:46:56.014366 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:46:56.022983 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jul 05 03:46:56.022983 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:46:56.023097 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jul 05 03:46:56.023097 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:46:56.023263 np0000004562 cinder-backup[101413]: WARNING os_brick.initiator.connectors.iscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jul 05 03:46:56.023263 np0000004562 cinder-backup[101413]: Jul 05 03:46:57.062336 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b9d14613-adf9-4674-a744-259f8b9d3b8e, portal: 192.168.40.100,3260] Jul 05 03:46:57.062336 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b9d14613-adf9-4674-a744-259f8b9d3b8e, portal: 192.168.40.100,3260] successful. Jul 05 03:46:57.062336 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:46:57.073417 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:46:57.085426 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] iscsiadm ('-m', 'session'): stdout=tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d14613-adf9-4674-a744-259f8b9d3b8e (non-flash) Jul 05 03:46:57.085426 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:46:57.085598 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] iscsi session list stdout=tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d14613-adf9-4674-a744-259f8b9d3b8e (non-flash) Jul 05 03:46:57.085598 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:46:57.086033 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b9d14613-adf9-4674-a744-259f8b9d3b8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.114s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:46:57.086180 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:46:57.086694 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] HCTL ('7', '-', '-', 0) found on session 193 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:46:57.086907 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:46:57.101852 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Searching for a device in session 193 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:46:57.102043 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9d14613-adf9-4674-a744-259f8b9d3b8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9d14613-adf9-4674-a744-259f8b9d3b8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:46:58.104692 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.143s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:46:58.105095 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] <== connect_volume: return (3144ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799204', 'path': '/dev/sdb'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:46:58.105354 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:46:58.123648 np0000004562 sudo[150928]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 05 03:46:58.124332 np0000004562 sudo[150928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:46:58.418090 np0000004562 sudo[150928]: pam_unix(sudo:session): session closed for user root Jul 05 03:46:58.420872 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.315s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:46:58.467730 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:46:58.472987 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] _create_container started, container: volumebackups,backup: 28bca471-de07-4765-8298-82b3d14218ed. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:46:58.591837 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] generate_object_name_prefix: volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:46:58.598122 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] starting backup of volume: b9d14613-adf9-4674-a744-259f8b9d3b8e, volume size: 1073741824, object names prefix volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:46:58.833527 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:46:59.082622 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:46:59.082794 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:46:59.185084 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] backup MD5 for volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:46:59.185476 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:46:59.357936 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:46:59.600126 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:46:59.600311 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:46:59.698479 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] backup MD5 for volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:46:59.698607 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:46:59.903942 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:00.143495 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:00.143622 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:00.241234 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] backup MD5 for volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:00.241705 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:00.470137 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:00.708106 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:00.708237 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:00.805020 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] backup MD5 for volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:00.805175 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:00.971055 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:01.207511 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:01.207511 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:01.303852 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] backup MD5 for volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:01.304350 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:01.488393 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:01.726464 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:01.726583 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:01.827154 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] backup MD5 for volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:01.827299 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:02.015199 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:02.251936 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:02.252156 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:02.352326 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] backup MD5 for volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:02.352882 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:02.526171 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:02.764620 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:02.764863 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:02.874571 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] backup MD5 for volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:02.874807 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:03.068365 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:03.308232 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:03.308419 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:03.430136 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] backup MD5 for volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:03.430561 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:03.624401 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:03.868257 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:03.868374 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:03.964528 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] backup MD5 for volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:03.964653 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:04.131430 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:04.373174 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:04.373300 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:04.469147 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] backup MD5 for volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:04.469653 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:04.640563 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:04.884674 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:04.884824 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:04.980773 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] backup MD5 for volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:04.980952 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:05.149630 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:05.385101 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:05.385199 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:05.484347 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] backup MD5 for volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:05.484860 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:05.667736 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:05.905509 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:05.905633 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:06.003216 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] backup MD5 for volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:06.003364 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:06.179439 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:06.426663 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:06.426841 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:06.536923 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] backup MD5 for volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:06.537284 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:06.742857 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:06.981384 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:06.981525 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:07.077952 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] backup MD5 for volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:07.078103 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:07.247036 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:07.486273 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:07.486417 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:07.588510 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] backup MD5 for volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:07.589099 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:07.769132 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:08.010736 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:08.010931 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:08.111530 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] backup MD5 for volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:08.111724 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:08.273427 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:08.530029 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:08.530307 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:08.626809 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] backup MD5 for volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:08.627085 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:08.823739 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:09.067989 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:09.068144 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:09.173222 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] backup MD5 for volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:09.173348 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:09.260125 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:09.377662 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:09.377662 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:09.508447 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] backup MD5 for volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:09.508686 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:09.517366 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:47:09.525175 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:47:09.525175 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:47:09.530250 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:47:09.530446 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:47:09.534862 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:47:09.534862 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:47:09.592603 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:47:09.593052 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] _write_metadata started, container name: volumebackups, metadata filename: volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:47:09.616508 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "28bca471-de07-4765-8298-82b3d14218ed",\n "backup_name": "tempest-CreateVolumesFromBackupTest-Backup-1522980119",\n "created_at": "2026-07-05 03:46:54+00:00",\n "objects": [\n {\n "volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "b9d14613-adf9-4674-a744-259f8b9d3b8e",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"b9d14613-adf9-4674-a744-259f8b9d3b8e\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"c083dbb11f46462c89efe438e3106f61\\", \\"project_id\\": \\"9654df19f7c740b284fd07a482320daa\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:46:53.000000\\", \\"launched_at\\": \\"2026-07-05T03:46:53.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-CreateVolumesFromBackupTest-Volume-495084800\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:46:53.000000\\", \\"updated_at\\": \\"2026-07-05T03:46:54.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:47:09.621372 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] backup 28bca471-de07-4765-8298-82b3d14218ed finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:47:09.743336 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:47:09.761215 np0000004562 sudo[151603]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 05 03:47:09.761880 np0000004562 sudo[151603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:47:10.075327 np0000004562 sudo[151603]: pam_unix(sudo:session): session closed for user root Jul 05 03:47:10.077485 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.334s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:47:10.078169 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9d14613-adf9-4674-a744-259f8b9d3b8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9d14613-adf9-4674-a744-259f8b9d3b8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799204', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:47:10.078363 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:47:10.078900 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:47:10.079276 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9d14613-adf9-4674-a744-259f8b9d3b8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9d14613-adf9-4674-a744-259f8b9d3b8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:47:10.093596 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:47:10.093596 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:47:10.093596 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:47:10.093596 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:47:10.093596 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:47:10.093596 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-51a79d57-38aa-47d4-9be7-7f006e1af42b Jul 05 03:47:10.093596 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:47:10.093596 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:47:10.093596 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:47:10.093596 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:47:10.093596 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea Jul 05 03:47:10.093596 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:47:10.093596 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:47:10.093596 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:47:10.093596 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:47:10.093596 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-b9d14613-adf9-4674-a744-259f8b9d3b8e Jul 05 03:47:10.093596 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:47:10.093596 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:47:10.093596 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-cf26c163-7336-46b1-940c-2995164c3927 Jul 05 03:47:10.093596 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:47:10.093596 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:47:10.093596 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:47:10.093596 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:47:10.093596 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:47:10.093596 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:47:10.093596 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:47:10.094200 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:47:10.094200 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:47:10.094200 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:47:10.094200 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9d14613-adf9-4674-a744-259f8b9d3b8e', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:47:10.117353 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] iscsiadm ('-m', 'session'): stdout=tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d14613-adf9-4674-a744-259f8b9d3b8e (non-flash) Jul 05 03:47:10.117353 np0000004562 cinder-backup[101413]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf26c163-7336-46b1-940c-2995164c3927 (non-flash) Jul 05 03:47:10.117353 np0000004562 cinder-backup[101413]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf26c163-7336-46b1-940c-2995164c3927 (non-flash) Jul 05 03:47:10.117353 np0000004562 cinder-backup[101413]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:10.117353 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:10.117353 np0000004562 cinder-backup[101413]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51a79d57-38aa-47d4-9be7-7f006e1af42b (non-flash) Jul 05 03:47:10.117353 np0000004562 cinder-backup[101413]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51a79d57-38aa-47d4-9be7-7f006e1af42b (non-flash) Jul 05 03:47:10.117353 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:47:10.117661 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] iscsi session list stdout=tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d14613-adf9-4674-a744-259f8b9d3b8e (non-flash) Jul 05 03:47:10.117661 np0000004562 cinder-backup[101413]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf26c163-7336-46b1-940c-2995164c3927 (non-flash) Jul 05 03:47:10.117661 np0000004562 cinder-backup[101413]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cf26c163-7336-46b1-940c-2995164c3927 (non-flash) Jul 05 03:47:10.117661 np0000004562 cinder-backup[101413]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:10.117661 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:10.117661 np0000004562 cinder-backup[101413]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51a79d57-38aa-47d4-9be7-7f006e1af42b (non-flash) Jul 05 03:47:10.117661 np0000004562 cinder-backup[101413]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51a79d57-38aa-47d4-9be7-7f006e1af42b (non-flash) Jul 05 03:47:10.117661 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:47:10.117661 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9d14613-adf9-4674-a744-259f8b9d3b8e', '193'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cf26c163-7336-46b1-940c-2995164c3927', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cf26c163-7336-46b1-940c-2995164c3927', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea', '197'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51a79d57-38aa-47d4-9be7-7f006e1af42b', '198'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51a79d57-38aa-47d4-9be7-7f006e1af42b', '199')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:47:10.117918 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b9d14613-adf9-4674-a744-259f8b9d3b8e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9d14613-adf9-4674-a744-259f8b9d3b8e', '193')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:47:10.118809 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Resulting device map defaultdict(. at 0x72a48e94e520>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9d14613-adf9-4674-a744-259f8b9d3b8e'): ({'sdb'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:47:10.119025 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Removing single pathed devices sdb {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:47:10.129426 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Flushing IO for device /dev/sdb {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:47:10.137253 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:47:10.197370 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:47:10.197563 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:47:10.198633 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:47:10.209859 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:47:10.210342 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9d14613-adf9-4674-a744-259f8b9d3b8e')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:47:10.221904 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:47:10.254444 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 193, target: iqn.2023-03.storpool.com:os--volume-b9d14613-adf9-4674-a744-259f8b9d3b8e, portal: 192.168.40.100,3260] Jul 05 03:47:10.254444 np0000004562 cinder-backup[101413]: Logout of [sid: 193, target: iqn.2023-03.storpool.com:os--volume-b9d14613-adf9-4674-a744-259f8b9d3b8e, portal: 192.168.40.100,3260] successful. Jul 05 03:47:10.254444 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:47:10.270504 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:47:10.270846 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.192s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:47:10.271069 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] <== disconnect_volume: return (192ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:47:11.293675 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-89ccbe93-752b-4c6e-8e2e-065f3a945479 tempest-CreateVolumesFromBackupTest-1474654034 None] Create backup finished. backup: 28bca471-de07-4765-8298-82b3d14218ed. Jul 05 03:47:11.783578 np0000004562 cinder-backup[101413]: DEBUG oslo_service.periodic_task [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:47:11.783790 np0000004562 cinder-backup[101413]: DEBUG cinder.manager [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Notifying Schedulers of capabilities ... {{(pid=101413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:47:12.714478 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-3531bf7c-fa72-4dc8-9d8a-533253359730 tempest-CreateVolumesFromBackupTest-1474654034 None] Delete backup started, backup: 28bca471-de07-4765-8298-82b3d14218ed. Jul 05 03:47:12.723203 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-3531bf7c-fa72-4dc8-9d8a-533253359730 tempest-CreateVolumesFromBackupTest-1474654034 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_9654df19f7c740b284fd07a482320daa {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:47:12.723727 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-3531bf7c-fa72-4dc8-9d8a-533253359730 tempest-CreateVolumesFromBackupTest-1474654034 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:47:12.723963 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3531bf7c-fa72-4dc8-9d8a-533253359730 tempest-CreateVolumesFromBackupTest-1474654034 None] delete started, backup: 28bca471-de07-4765-8298-82b3d14218ed, container: volumebackups, prefix: volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:47:12.768501 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3531bf7c-fa72-4dc8-9d8a-533253359730 tempest-CreateVolumesFromBackupTest-1474654034 None] generated object list: ['volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00001', 'volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00002', 'volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00003', 'volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00004', 'volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00005', 'volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00006', 'volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00007', 'volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00008', 'volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00009', 'volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00010', 'volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00011', 'volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00012', 'volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00013', 'volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00014', 'volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00015', 'volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00016', 'volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00017', 'volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00018', 'volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00019', 'volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00020', 'volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00021', 'volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed_metadata', 'volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:47:12.786188 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3531bf7c-fa72-4dc8-9d8a-533253359730 tempest-CreateVolumesFromBackupTest-1474654034 None] deleted object: volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00001 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:12.806173 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3531bf7c-fa72-4dc8-9d8a-533253359730 tempest-CreateVolumesFromBackupTest-1474654034 None] deleted object: volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00002 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:12.823997 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3531bf7c-fa72-4dc8-9d8a-533253359730 tempest-CreateVolumesFromBackupTest-1474654034 None] deleted object: volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00003 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:12.844358 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3531bf7c-fa72-4dc8-9d8a-533253359730 tempest-CreateVolumesFromBackupTest-1474654034 None] deleted object: volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00004 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:12.862442 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3531bf7c-fa72-4dc8-9d8a-533253359730 tempest-CreateVolumesFromBackupTest-1474654034 None] deleted object: volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00005 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:12.881846 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3531bf7c-fa72-4dc8-9d8a-533253359730 tempest-CreateVolumesFromBackupTest-1474654034 None] deleted object: volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00006 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:12.898574 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3531bf7c-fa72-4dc8-9d8a-533253359730 tempest-CreateVolumesFromBackupTest-1474654034 None] deleted object: volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00007 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:12.918505 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3531bf7c-fa72-4dc8-9d8a-533253359730 tempest-CreateVolumesFromBackupTest-1474654034 None] deleted object: volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00008 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:12.934689 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3531bf7c-fa72-4dc8-9d8a-533253359730 tempest-CreateVolumesFromBackupTest-1474654034 None] deleted object: volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00009 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:12.950807 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3531bf7c-fa72-4dc8-9d8a-533253359730 tempest-CreateVolumesFromBackupTest-1474654034 None] deleted object: volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00010 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:12.965846 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3531bf7c-fa72-4dc8-9d8a-533253359730 tempest-CreateVolumesFromBackupTest-1474654034 None] deleted object: volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00011 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:12.980361 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3531bf7c-fa72-4dc8-9d8a-533253359730 tempest-CreateVolumesFromBackupTest-1474654034 None] deleted object: volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00012 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:12.996396 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3531bf7c-fa72-4dc8-9d8a-533253359730 tempest-CreateVolumesFromBackupTest-1474654034 None] deleted object: volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00013 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:13.014653 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3531bf7c-fa72-4dc8-9d8a-533253359730 tempest-CreateVolumesFromBackupTest-1474654034 None] deleted object: volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00014 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:13.029538 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3531bf7c-fa72-4dc8-9d8a-533253359730 tempest-CreateVolumesFromBackupTest-1474654034 None] deleted object: volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00015 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:13.046355 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3531bf7c-fa72-4dc8-9d8a-533253359730 tempest-CreateVolumesFromBackupTest-1474654034 None] deleted object: volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00016 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:13.061278 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3531bf7c-fa72-4dc8-9d8a-533253359730 tempest-CreateVolumesFromBackupTest-1474654034 None] deleted object: volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00017 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:13.078067 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3531bf7c-fa72-4dc8-9d8a-533253359730 tempest-CreateVolumesFromBackupTest-1474654034 None] deleted object: volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00018 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:13.097366 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3531bf7c-fa72-4dc8-9d8a-533253359730 tempest-CreateVolumesFromBackupTest-1474654034 None] deleted object: volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00019 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:13.115545 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3531bf7c-fa72-4dc8-9d8a-533253359730 tempest-CreateVolumesFromBackupTest-1474654034 None] deleted object: volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00020 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:13.132599 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3531bf7c-fa72-4dc8-9d8a-533253359730 tempest-CreateVolumesFromBackupTest-1474654034 None] deleted object: volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed-00021 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:13.150059 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3531bf7c-fa72-4dc8-9d8a-533253359730 tempest-CreateVolumesFromBackupTest-1474654034 None] deleted object: volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed_metadata in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:13.166663 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3531bf7c-fa72-4dc8-9d8a-533253359730 tempest-CreateVolumesFromBackupTest-1474654034 None] deleted object: volume_b9d14613-adf9-4674-a744-259f8b9d3b8e/20260705034658/az_nova_backup_28bca471-de07-4765-8298-82b3d14218ed_sha256file in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:13.166875 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3531bf7c-fa72-4dc8-9d8a-533253359730 tempest-CreateVolumesFromBackupTest-1474654034 None] delete 28bca471-de07-4765-8298-82b3d14218ed finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:47:13.198257 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-3531bf7c-fa72-4dc8-9d8a-533253359730 tempest-CreateVolumesFromBackupTest-1474654034 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:47:13.212660 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-3531bf7c-fa72-4dc8-9d8a-533253359730 tempest-CreateVolumesFromBackupTest-1474654034 None] Created reservations ['ca9a0c60-3623-4bc9-9581-46e65b916b18', '93ac8341-0705-4cb7-bb01-ef7e838ee623'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:47:13.230204 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-3531bf7c-fa72-4dc8-9d8a-533253359730 tempest-CreateVolumesFromBackupTest-1474654034 None] Delete backup finished, backup 28bca471-de07-4765-8298-82b3d14218ed deleted. Jul 05 03:47:23.227219 np0000004562 cinder-backup[101413]: DEBUG dbcounter [-] [101413] Writing DB stats cinder:SELECT=38,cinder:UPDATE=12,cinder:INSERT=2 {{(pid=101413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:47:36.894284 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Create backup started, backup: 0b139eba-74ef-4b2a-a75f-610492d814c1 volume: d89133b6-93f4-4e56-909a-bae2d1fa6a1d. Jul 05 03:47:36.898640 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T03:47:36Z,data_timestamp=2026-07-05T03:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-792819402',encryption_key_id=None,fail_reason=None,host='np0000004562',id=0b139eba-74ef-4b2a-a75f-610492d814c1,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='2ee62c33d51844a9a90e9a9e640d703b',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='ea1163b57d574d8c9031fe9c82c96b2c',volume_id=d89133b6-93f4-4e56-909a-bae2d1fa6a1d) Jul 05 03:47:36.922292 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_2ee62c33d51844a9a90e9a9e640d703b {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:47:36.922681 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:47:36.923449 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:47:36.934217 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:47:36.955469 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:47:36.969196 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:47:36.969518 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:47:36.978639 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:47:36.980112 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe3a:a676', 'fe80::e477:baff:fee9:cab5'] Jul 05 03:47:36.980112 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:47:36.980112 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:47:36.980391 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] <== get_connector_properties: return (56ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:47:37.485086 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:47:37.485631 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd89133b6-93f4-4e56-909a-bae2d1fa6a1d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:47:37.485631 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:47:38.942680 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.457s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:47:38.943097 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd89133b6-93f4-4e56-909a-bae2d1fa6a1d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:47:38.955852 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:47:38.956326 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:47:38.956551 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:47:38.969805 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:47:38.969805 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:47:38.981448 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d] added Jul 05 03:47:38.981448 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:47:38.981448 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:47:38.981448 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:47:38.981448 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:47:38.981448 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:47:38.981448 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:47:38.981841 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:47:38.982574 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0257(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:47:38.983330 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:47:39.985148 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:47:39.996481 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:47:40.007049 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:47:40.021262 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:40.021262 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:40.021262 np0000004562 cinder-backup[101413]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:47:40.021262 np0000004562 cinder-backup[101413]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:47:40.021262 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:47:40.021519 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:40.021519 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:40.021519 np0000004562 cinder-backup[101413]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:47:40.021519 np0000004562 cinder-backup[101413]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:47:40.021519 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:47:40.060964 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d, portal: 192.168.40.100,3260] Jul 05 03:47:40.060964 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d, portal: 192.168.40.100,3260] successful. Jul 05 03:47:40.060964 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:47:40.072195 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:47:40.084301 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:40.084301 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:40.084301 np0000004562 cinder-backup[101413]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:47:40.084301 np0000004562 cinder-backup[101413]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:47:40.084301 np0000004562 cinder-backup[101413]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d (non-flash) Jul 05 03:47:40.084301 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:47:40.084502 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:40.084502 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:40.084502 np0000004562 cinder-backup[101413]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:47:40.084502 np0000004562 cinder-backup[101413]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:47:40.084502 np0000004562 cinder-backup[101413]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d (non-flash) Jul 05 03:47:40.084502 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:47:40.084755 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.128s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:47:40.084901 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:47:40.085541 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] HCTL ('9', '-', '-', 0) found on session 204 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:47:40.085688 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Scanning host 9 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:47:40.096920 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Searching for a device in session 204 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:47:40.096920 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd89133b6-93f4-4e56-909a-bae2d1fa6a1d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:47:40.743456 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:47:40.748843 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Create backup started, backup: 1bb96db2-4fd7-4abb-affd-bf6a8751624a volume: 8dca60f2-18e6-45e0-91bd-8faa0acb5a5d. Jul 05 03:47:40.753796 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T03:47:40Z,data_timestamp=2026-07-05T03:47:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-600124228',encryption_key_id=None,fail_reason=None,host='np0000004562',id=1bb96db2-4fd7-4abb-affd-bf6a8751624a,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='57a311cbff5648e6a0168be82134cf61',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='b164eb7acb8f4f6caa1ce5a85a398ac0',volume_id=8dca60f2-18e6-45e0-91bd-8faa0acb5a5d) Jul 05 03:47:40.803579 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_57a311cbff5648e6a0168be82134cf61 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:47:40.803904 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:47:40.804151 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:47:40.813626 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:47:40.830301 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:47:40.842866 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:47:40.843201 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:47:40.850507 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:47:40.851650 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe3a:a676', 'fe80::e477:baff:fee9:cab5'] Jul 05 03:47:40.851896 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:47:40.852107 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:47:40.852461 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] <== get_connector_properties: return (47ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:47:41.099690 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.157s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:47:41.099994 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] <== connect_volume: return (3614ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799230', 'path': '/dev/sdd'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:47:41.100194 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:47:41.121133 np0000004562 sudo[152266]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd Jul 05 03:47:41.122040 np0000004562 sudo[152266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:47:41.357537 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:47:41.358071 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8dca60f2-18e6-45e0-91bd-8faa0acb5a5d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8dca60f2-18e6-45e0-91bd-8faa0acb5a5d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:47:41.358288 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:47:41.358860 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:47:41.359133 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8dca60f2-18e6-45e0-91bd-8faa0acb5a5d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8dca60f2-18e6-45e0-91bd-8faa0acb5a5d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:47:41.370218 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8dca60f2-18e6-45e0-91bd-8faa0acb5a5d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:47:41.370684 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8dca60f2-18e6-45e0-91bd-8faa0acb5a5d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:47:41.370954 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:47:41.381404 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:47:41.381404 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:47:41.395229 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8dca60f2-18e6-45e0-91bd-8faa0acb5a5d] added Jul 05 03:47:41.395229 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:47:41.395229 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:47:41.395229 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:47:41.395229 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:47:41.395229 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:47:41.395229 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:47:41.395414 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:47:41.395965 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0249(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:47:41.396205 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:47:41.419433 np0000004562 sudo[152266]: pam_unix(sudo:session): session closed for user root Jul 05 03:47:41.421392 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd" returned: 0 in 0.321s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:47:41.473459 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:47:41.479598 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] _create_container started, container: volumebackups,backup: 0b139eba-74ef-4b2a-a75f-610492d814c1. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:47:41.698445 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] generate_object_name_prefix: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1 {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:47:41.704419 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] starting backup of volume: d89133b6-93f4-4e56-909a-bae2d1fa6a1d, volume size: 1073741824, object names prefix volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:47:41.873059 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:42.118968 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:42.119418 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:42.221958 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:42.222182 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:42.395506 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:42.396690 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-8dca60f2-18e6-45e0-91bd-8faa0acb5a5d Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:47:42.406668 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:47:42.416916 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:47:42.428635 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:42.428635 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:42.428635 np0000004562 cinder-backup[101413]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:47:42.428635 np0000004562 cinder-backup[101413]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:47:42.428635 np0000004562 cinder-backup[101413]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d (non-flash) Jul 05 03:47:42.428635 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:47:42.428821 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:42.428821 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:42.428821 np0000004562 cinder-backup[101413]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:47:42.428821 np0000004562 cinder-backup[101413]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:47:42.428821 np0000004562 cinder-backup[101413]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d (non-flash) Jul 05 03:47:42.428821 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:47:42.462825 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8dca60f2-18e6-45e0-91bd-8faa0acb5a5d, portal: 192.168.40.100,3260] Jul 05 03:47:42.462825 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8dca60f2-18e6-45e0-91bd-8faa0acb5a5d, portal: 192.168.40.100,3260] successful. Jul 05 03:47:42.462825 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:47:42.473247 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:47:42.486260 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:42.486260 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:42.486260 np0000004562 cinder-backup[101413]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:47:42.486260 np0000004562 cinder-backup[101413]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:47:42.486260 np0000004562 cinder-backup[101413]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d (non-flash) Jul 05 03:47:42.486260 np0000004562 cinder-backup[101413]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dca60f2-18e6-45e0-91bd-8faa0acb5a5d (non-flash) Jul 05 03:47:42.486260 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:47:42.487457 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:42.487457 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:42.487457 np0000004562 cinder-backup[101413]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:47:42.487457 np0000004562 cinder-backup[101413]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:47:42.487457 np0000004562 cinder-backup[101413]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d (non-flash) Jul 05 03:47:42.487457 np0000004562 cinder-backup[101413]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dca60f2-18e6-45e0-91bd-8faa0acb5a5d (non-flash) Jul 05 03:47:42.487457 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:47:42.487457 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8dca60f2-18e6-45e0-91bd-8faa0acb5a5d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.116s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:47:42.487457 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:47:42.487697 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] HCTL ('12', '-', '-', 0) found on session 205 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:47:42.488173 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Scanning host 12 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:47:42.505521 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Searching for a device in session 205 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:47:42.505521 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8dca60f2-18e6-45e0-91bd-8faa0acb5a5d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8dca60f2-18e6-45e0-91bd-8faa0acb5a5d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:47:42.634823 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:42.634954 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:42.737531 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:42.737802 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:42.907073 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:43.148217 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:43.148688 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:43.248142 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:43.248424 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:43.471370 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:43.509573 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.151s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:47:43.509865 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] <== connect_volume: return (2151ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799231', 'path': '/dev/sdg'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:47:43.510261 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdg {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:47:43.533367 np0000004562 sudo[152387]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdg Jul 05 03:47:43.534035 np0000004562 sudo[152387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:47:43.724266 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:43.724501 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:43.830479 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:43.830658 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:43.838917 np0000004562 sudo[152387]: pam_unix(sudo:session): session closed for user root Jul 05 03:47:43.840479 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdg" returned: 0 in 0.330s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:47:43.847521 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] _create_container started, container: volumebackups,backup: 1bb96db2-4fd7-4abb-affd-bf6a8751624a. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:47:44.019117 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:44.037073 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] generate_object_name_prefix: volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:47:44.042363 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] starting backup of volume: 8dca60f2-18e6-45e0-91bd-8faa0acb5a5d, volume size: 1073741824, object names prefix volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:47:44.207484 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:44.275528 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:44.275670 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:44.376283 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:44.376485 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:44.450208 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:44.450405 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:44.548888 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:44.557577 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:44.557793 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:44.747199 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:44.810248 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:44.810607 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:44.914946 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:44.917111 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:45.091846 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:45.091846 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:45.092518 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:45.212556 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:45.212556 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:45.339575 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:45.341027 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:45.439814 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:45.467563 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:45.467776 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:45.655735 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:45.702246 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:45.702246 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:45.806196 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:45.806196 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:45.894533 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:45.894533 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:45.980483 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:45.997584 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:45.997584 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:46.173320 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:46.224456 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:46.225250 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:46.322857 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:46.323994 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:46.495878 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:46.505773 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:46.505773 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:46.604101 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:46.604101 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:46.740041 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:46.740168 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:46.801733 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:46.851174 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:46.851327 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:47.029770 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:47.078661 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:47.078859 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:47.177738 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:47.177864 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:47.268468 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:47.269005 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:47.367992 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:47.368209 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:47.404411 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:47.571146 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:47.659943 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:47.660181 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:47.760630 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:47.760945 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:48.028083 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:48.035101 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:48.036126 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:48.145867 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:48.146012 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:48.294899 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:48.295288 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:48.339497 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:48.400520 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:48.400789 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:48.582146 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:48.590010 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:48.590125 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:48.687537 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:48.687671 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:48.827016 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:48.827166 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:48.879344 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:48.929180 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:48.929342 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:49.107807 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:49.209769 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:49.210751 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:49.313302 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:49.313302 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:49.383068 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:49.383068 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:49.487592 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:49.487907 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:49.499338 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:49.682305 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:49.740777 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:49.740777 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:49.848397 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:49.848397 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:49.939803 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:49.939921 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:50.026105 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:50.039358 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:50.039557 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:50.239991 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:50.276007 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:50.276122 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:50.373699 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:50.373699 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:50.482736 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:50.482863 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:50.560158 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:50.580459 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:50.580572 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:50.799730 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:50.814988 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:50.815092 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:50.917392 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:50.917513 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:51.056820 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:51.056972 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:51.146361 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:51.157288 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:51.157410 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:51.363069 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:51.391446 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:51.391446 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:51.489378 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:51.489554 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:51.609208 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:51.609413 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:51.674659 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:51.714386 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:51.714585 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:51.891534 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:51.922861 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:51.923044 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:52.023563 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:52.023765 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:52.154586 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:52.154737 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:52.221461 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:52.277193 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:52.277440 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:52.458927 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:52.469188 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:52.469188 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:52.572269 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:52.572269 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:52.715742 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:52.715869 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:52.754388 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:52.814184 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:52.814314 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:52.907740 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:53.005472 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:53.005606 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:53.040250 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:53.040378 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:53.099364 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:53.099505 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:53.103370 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:53.103674 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:53.107302 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:47:53.141223 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:47:53.141519 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:47:53.147442 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:47:53.147623 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:47:53.150916 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:47:53.151146 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:47:53.206003 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:47:53.206634 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] _write_metadata started, container name: volumebackups, metadata filename: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:47:53.228770 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "0b139eba-74ef-4b2a-a75f-610492d814c1",\n "backup_name": "tempest-VolumesBackupsTest-Backup-792819402",\n "created_at": "2026-07-05 03:47:37+00:00",\n "objects": [\n {\n "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "d89133b6-93f4-4e56-909a-bae2d1fa6a1d",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"d89133b6-93f4-4e56-909a-bae2d1fa6a1d\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"ea1163b57d574d8c9031fe9c82c96b2c\\", \\"project_id\\": \\"2ee62c33d51844a9a90e9a9e640d703b\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:47:36.000000\\", \\"launched_at\\": \\"2026-07-05T03:47:36.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1919702748\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:47:36.000000\\", \\"updated_at\\": \\"2026-07-05T03:47:37.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:47:53.234278 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] backup 0b139eba-74ef-4b2a-a75f-610492d814c1 finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:47:53.355471 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:47:53.379382 np0000004562 sudo[152526]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd Jul 05 03:47:53.380002 np0000004562 sudo[152526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:47:53.399667 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:53.640064 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:53.640543 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:53.658394 np0000004562 sudo[152526]: pam_unix(sudo:session): session closed for user root Jul 05 03:47:53.660173 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd" returned: 0 in 0.305s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:47:53.660916 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd89133b6-93f4-4e56-909a-bae2d1fa6a1d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799230', 'path': '/dev/sdd'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:47:53.661180 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:47:53.661728 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:47:53.662198 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd89133b6-93f4-4e56-909a-bae2d1fa6a1d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:47:53.672614 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:47:53.672614 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:47:53.672614 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:47:53.672614 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:47:53.672614 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:47:53.672614 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea Jul 05 03:47:53.672614 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:47:53.672614 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:47:53.672614 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:47:53.672614 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:47:53.672614 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d Jul 05 03:47:53.672614 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:47:53.672614 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:47:53.672614 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-8dca60f2-18e6-45e0-91bd-8faa0acb5a5d Jul 05 03:47:53.672614 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:47:53.672614 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:47:53.672614 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:47:53.672614 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:47:53.672614 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:47:53.673181 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:47:53.673181 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:47:53.673181 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:47:53.673181 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:47:53.697894 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:53.697894 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:53.697894 np0000004562 cinder-backup[101413]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d (non-flash) Jul 05 03:47:53.697894 np0000004562 cinder-backup[101413]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dca60f2-18e6-45e0-91bd-8faa0acb5a5d (non-flash) Jul 05 03:47:53.697894 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:47:53.698113 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:53.698113 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:53.698113 np0000004562 cinder-backup[101413]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d (non-flash) Jul 05 03:47:53.698113 np0000004562 cinder-backup[101413]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dca60f2-18e6-45e0-91bd-8faa0acb5a5d (non-flash) Jul 05 03:47:53.698113 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:47:53.698216 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea', '197'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d', '204'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8dca60f2-18e6-45e0-91bd-8faa0acb5a5d', '205')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:47:53.698325 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d', '204')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:47:53.699304 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Resulting device map defaultdict(. at 0x72a48e94e520>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d'): ({'sdd'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:47:53.699500 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Removing single pathed devices sdd {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:47:53.712273 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Flushing IO for device /dev/sdd {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:47:53.719797 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:47:53.741370 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:53.741505 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:53.771222 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Checking to see if SCSI volumes sdd have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:47:53.771429 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] SCSI volumes sdd have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:47:53.772348 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Checking to see if device paths {'sdd'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:47:53.783861 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Device paths {'sdd'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:47:53.784076 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:47:53.795263 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:47:53.822204 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 204, target: iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d, portal: 192.168.40.100,3260] Jul 05 03:47:53.822204 np0000004562 cinder-backup[101413]: Logout of [sid: 204, target: iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d, portal: 192.168.40.100,3260] successful. Jul 05 03:47:53.822204 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:47:53.837196 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:47:53.837531 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.176s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:47:53.837786 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] <== disconnect_volume: return (177ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:47:53.957766 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:54.193862 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:54.194005 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:54.290917 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:54.291056 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:54.459663 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:54.707279 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:54.707787 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:54.804354 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:54.804533 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:54.857567 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-98857b11-f93f-4465-a58e-bb169afc076d tempest-VolumesBackupsTest-1375540242 None] Create backup finished. backup: 0b139eba-74ef-4b2a-a75f-610492d814c1. Jul 05 03:47:54.987467 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:55.225737 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:55.225877 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:55.274362 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Restore backup started, backup: 0b139eba-74ef-4b2a-a75f-610492d814c1 volume: d89133b6-93f4-4e56-909a-bae2d1fa6a1d. Jul 05 03:47:55.287376 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_2ee62c33d51844a9a90e9a9e640d703b {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:47:55.287572 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:47:55.287893 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:47:55.298047 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:47:55.316333 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:47:55.327146 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:55.327402 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:55.360954 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:47:55.362319 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:47:55.368510 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:47:55.370440 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:47:55.371266 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe3a:a676', 'fe80::e477:baff:fee9:cab5'] Jul 05 03:47:55.371441 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:47:55.371629 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:47:55.372062 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:47:55.462461 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:47:55.577104 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:47:55.577226 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:47:55.635632 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:47:55.635808 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:47:55.644278 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:47:55.650347 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:47:55.650347 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:47:55.653690 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:47:55.653842 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:47:55.656526 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:47:55.656784 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:47:55.710246 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:47:55.711120 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] _write_metadata started, container name: volumebackups, metadata filename: volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:47:55.733930 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "1bb96db2-4fd7-4abb-affd-bf6a8751624a",\n "backup_name": "tempest-VolumesBackupsTest-Backup-600124228",\n "created_at": "2026-07-05 03:47:41+00:00",\n "objects": [\n {\n "volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "8dca60f2-18e6-45e0-91bd-8faa0acb5a5d",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"8dca60f2-18e6-45e0-91bd-8faa0acb5a5d\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"b164eb7acb8f4f6caa1ce5a85a398ac0\\", \\"project_id\\": \\"57a311cbff5648e6a0168be82134cf61\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:47:40.000000\\", \\"launched_at\\": \\"2026-07-05T03:47:40.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1069618120\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:47:39.000000\\", \\"updated_at\\": \\"2026-07-05T03:47:41.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:47:55.740731 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] backup 1bb96db2-4fd7-4abb-affd-bf6a8751624a finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:47:55.860198 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdg {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:47:55.879898 np0000004562 sudo[152577]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdg Jul 05 03:47:55.880642 np0000004562 sudo[152577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:47:56.162255 np0000004562 sudo[152577]: pam_unix(sudo:session): session closed for user root Jul 05 03:47:56.164214 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdg" returned: 0 in 0.304s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:47:56.164853 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8dca60f2-18e6-45e0-91bd-8faa0acb5a5d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8dca60f2-18e6-45e0-91bd-8faa0acb5a5d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799231', 'path': '/dev/sdg'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:47:56.165074 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:47:56.165485 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:47:56.165865 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8dca60f2-18e6-45e0-91bd-8faa0acb5a5d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8dca60f2-18e6-45e0-91bd-8faa0acb5a5d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:47:56.177975 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:47:56.177975 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:47:56.177975 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:47:56.177975 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:47:56.177975 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:47:56.177975 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea Jul 05 03:47:56.177975 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:47:56.177975 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:47:56.177975 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:47:56.177975 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:47:56.177975 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-8dca60f2-18e6-45e0-91bd-8faa0acb5a5d Jul 05 03:47:56.177975 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:47:56.177975 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:47:56.177975 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:47:56.177975 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:47:56.177975 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:47:56.178361 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:47:56.178361 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:47:56.178361 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:47:56.178361 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8dca60f2-18e6-45e0-91bd-8faa0acb5a5d', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:47:56.199507 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:56.199507 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:56.199507 np0000004562 cinder-backup[101413]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dca60f2-18e6-45e0-91bd-8faa0acb5a5d (non-flash) Jul 05 03:47:56.199507 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:47:56.199757 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:56.199757 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:56.199757 np0000004562 cinder-backup[101413]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dca60f2-18e6-45e0-91bd-8faa0acb5a5d (non-flash) Jul 05 03:47:56.199757 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:47:56.199863 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea', '197'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8dca60f2-18e6-45e0-91bd-8faa0acb5a5d', '205')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:47:56.199964 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8dca60f2-18e6-45e0-91bd-8faa0acb5a5d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8dca60f2-18e6-45e0-91bd-8faa0acb5a5d', '205')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:47:56.200763 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Resulting device map defaultdict(. at 0x72a470327920>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8dca60f2-18e6-45e0-91bd-8faa0acb5a5d'): ({'sdg'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:47:56.200974 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Removing single pathed devices sdg {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:47:56.209280 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Flushing IO for device /dev/sdg {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:47:56.215596 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:47:56.258078 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Checking to see if SCSI volumes sdg have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:47:56.258246 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] SCSI volumes sdg have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:47:56.259044 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Checking to see if device paths {'sdg'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:47:56.269561 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Device paths {'sdg'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:47:56.269773 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8dca60f2-18e6-45e0-91bd-8faa0acb5a5d')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:47:56.278967 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:47:56.307490 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 205, target: iqn.2023-03.storpool.com:os--volume-8dca60f2-18e6-45e0-91bd-8faa0acb5a5d, portal: 192.168.40.100,3260] Jul 05 03:47:56.307490 np0000004562 cinder-backup[101413]: Logout of [sid: 205, target: iqn.2023-03.storpool.com:os--volume-8dca60f2-18e6-45e0-91bd-8faa0acb5a5d, portal: 192.168.40.100,3260] successful. Jul 05 03:47:56.307490 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:47:56.318434 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:47:56.318682 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.153s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:47:56.318853 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] <== disconnect_volume: return (154ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:47:56.483144 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:47:56.483434 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd89133b6-93f4-4e56-909a-bae2d1fa6a1d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:47:56.483566 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:47:56.483881 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:47:56.484056 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd89133b6-93f4-4e56-909a-bae2d1fa6a1d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:47:56.497374 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:47:56.497671 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:47:56.497896 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:47:56.507929 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:47:56.507929 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:47:56.516458 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d] added Jul 05 03:47:56.516458 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:47:56.516458 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:47:56.516458 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:47:56.516458 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:47:56.516458 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:47:56.516458 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:47:56.516693 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:47:56.517052 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0191(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:47:56.517279 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:47:57.335563 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-19dc1712-e2dd-4487-afa8-53b1933bcace tempest-VolumesBackupsTest-1992217419 None] Create backup finished. backup: 1bb96db2-4fd7-4abb-affd-bf6a8751624a. Jul 05 03:47:57.518604 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:47:57.528705 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:47:57.538445 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:47:57.548231 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:57.548231 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:57.548231 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:47:57.548374 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:57.548374 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:57.548374 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:47:57.574890 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d, portal: 192.168.40.100,3260] Jul 05 03:47:57.574890 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d, portal: 192.168.40.100,3260] successful. Jul 05 03:47:57.574890 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:47:57.585175 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:47:57.596684 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:57.596684 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:57.596684 np0000004562 cinder-backup[101413]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d (non-flash) Jul 05 03:47:57.596684 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:47:57.596684 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:57.596684 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:47:57.596684 np0000004562 cinder-backup[101413]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d (non-flash) Jul 05 03:47:57.596684 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:47:57.596996 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.099s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:47:57.597126 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:47:57.597654 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] HCTL ('7', '-', '-', 0) found on session 206 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:47:57.597816 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:47:57.609890 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Searching for a device in session 206 and hctl ['7', '*', '*', 0] yield: None {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:47:58.191067 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-e16721df-babf-4d57-bbfd-666791e5cc00 tempest-VolumesBackupsTest-1992217419 None] Delete backup started, backup: 1bb96db2-4fd7-4abb-affd-bf6a8751624a. Jul 05 03:47:58.195458 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-e16721df-babf-4d57-bbfd-666791e5cc00 tempest-VolumesBackupsTest-1992217419 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_57a311cbff5648e6a0168be82134cf61 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:47:58.195649 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-e16721df-babf-4d57-bbfd-666791e5cc00 tempest-VolumesBackupsTest-1992217419 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:47:58.195948 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e16721df-babf-4d57-bbfd-666791e5cc00 tempest-VolumesBackupsTest-1992217419 None] delete started, backup: 1bb96db2-4fd7-4abb-affd-bf6a8751624a, container: volumebackups, prefix: volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:47:58.230770 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e16721df-babf-4d57-bbfd-666791e5cc00 tempest-VolumesBackupsTest-1992217419 None] generated object list: ['volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00001', 'volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00002', 'volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00003', 'volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00004', 'volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00005', 'volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00006', 'volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00007', 'volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00008', 'volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00009', 'volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00010', 'volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00011', 'volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00012', 'volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00013', 'volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00014', 'volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00015', 'volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00016', 'volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00017', 'volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00018', 'volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00019', 'volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00020', 'volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00021', 'volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a_metadata', 'volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:47:58.252941 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e16721df-babf-4d57-bbfd-666791e5cc00 tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00001 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:58.269108 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e16721df-babf-4d57-bbfd-666791e5cc00 tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00002 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:58.286345 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e16721df-babf-4d57-bbfd-666791e5cc00 tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00003 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:58.303309 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e16721df-babf-4d57-bbfd-666791e5cc00 tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00004 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:58.318874 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e16721df-babf-4d57-bbfd-666791e5cc00 tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00005 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:58.334545 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e16721df-babf-4d57-bbfd-666791e5cc00 tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00006 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:58.351540 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e16721df-babf-4d57-bbfd-666791e5cc00 tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00007 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:58.367870 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e16721df-babf-4d57-bbfd-666791e5cc00 tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00008 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:58.383859 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e16721df-babf-4d57-bbfd-666791e5cc00 tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00009 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:58.399582 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e16721df-babf-4d57-bbfd-666791e5cc00 tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00010 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:58.414937 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e16721df-babf-4d57-bbfd-666791e5cc00 tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00011 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:58.430603 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e16721df-babf-4d57-bbfd-666791e5cc00 tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00012 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:58.447813 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e16721df-babf-4d57-bbfd-666791e5cc00 tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00013 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:58.465177 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e16721df-babf-4d57-bbfd-666791e5cc00 tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00014 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:58.481485 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e16721df-babf-4d57-bbfd-666791e5cc00 tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00015 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:58.497547 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e16721df-babf-4d57-bbfd-666791e5cc00 tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00016 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:58.513792 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e16721df-babf-4d57-bbfd-666791e5cc00 tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00017 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:58.529982 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e16721df-babf-4d57-bbfd-666791e5cc00 tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00018 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:58.547819 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e16721df-babf-4d57-bbfd-666791e5cc00 tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00019 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:58.564199 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e16721df-babf-4d57-bbfd-666791e5cc00 tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00020 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:58.581469 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e16721df-babf-4d57-bbfd-666791e5cc00 tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a-00021 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:58.599292 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e16721df-babf-4d57-bbfd-666791e5cc00 tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a_metadata in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:58.610067 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Searching for a device in session 206 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:47:58.610233 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd89133b6-93f4-4e56-909a-bae2d1fa6a1d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:47:58.610778 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.127s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:47:58.610935 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] <== connect_volume: return (2127ms) {'type': 'block', 'scsi_wwn': '330000000e063100d', 'path': '/dev/sdb'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:47:58.611227 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:47:58.621233 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e16721df-babf-4d57-bbfd-666791e5cc00 tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_8dca60f2-18e6-45e0-91bd-8faa0acb5a5d/20260705034744/az_nova_backup_1bb96db2-4fd7-4abb-affd-bf6a8751624a_sha256file in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:47:58.621508 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e16721df-babf-4d57-bbfd-666791e5cc00 tempest-VolumesBackupsTest-1992217419 None] delete 1bb96db2-4fd7-4abb-affd-bf6a8751624a finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:47:58.629383 np0000004562 sudo[152652]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 05 03:47:58.629993 np0000004562 sudo[152652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:47:58.656986 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-e16721df-babf-4d57-bbfd-666791e5cc00 tempest-VolumesBackupsTest-1992217419 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:47:58.669423 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-e16721df-babf-4d57-bbfd-666791e5cc00 tempest-VolumesBackupsTest-1992217419 None] Created reservations ['b2f37780-7d03-4693-a50d-375c2d12a34c', '117ea53b-3484-403e-ac51-0c75a638e9c0'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:47:58.683762 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-e16721df-babf-4d57-bbfd-666791e5cc00 tempest-VolumesBackupsTest-1992217419 None] Delete backup finished, backup 1bb96db2-4fd7-4abb-affd-bf6a8751624a deleted. Jul 05 03:47:58.925069 np0000004562 sudo[152652]: pam_unix(sudo:session): session closed for user root Jul 05 03:47:58.926854 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.315s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:47:58.927171 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] starting restore of backup volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1 container: volumebackups, to existing volume d89133b6-93f4-4e56-909a-bae2d1fa6a1d, backup: 0b139eba-74ef-4b2a-a75f-610492d814c1. {{(pid=101413) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jul 05 03:47:58.927340 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] _read_metadata started, container name: volumebackups, metadata filename: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1_metadata. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] _read_metadata finished. Metadata: { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "backup_description": null, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "backup_id": "0b139eba-74ef-4b2a-a75f-610492d814c1", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "backup_name": "tempest-VolumesBackupsTest-Backup-792819402", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "created_at": "2026-07-05 03:47:37+00:00", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "objects": [ Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00001": { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "offset": 0 Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00002": { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "offset": 52428800 Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00003": { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "offset": 104857600 Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00004": { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "offset": 157286400 Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00005": { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "offset": 209715200 Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00006": { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "offset": 262144000 Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00007": { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "offset": 314572800 Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00008": { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "offset": 367001600 Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00009": { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "offset": 419430400 Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00010": { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "offset": 471859200 Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00011": { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "offset": 524288000 Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00012": { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "offset": 576716800 Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00013": { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "offset": 629145600 Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00014": { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "offset": 681574400 Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00015": { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "offset": 734003200 Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00016": { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "offset": 786432000 Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00017": { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "offset": 838860800 Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00018": { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "offset": 891289600 Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00019": { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "offset": 943718400 Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00020": { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "offset": 996147200 Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00021": { Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "length": 25165824, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "offset": 1048576000 Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: ], Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "parent_id": null, Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "version": "1.0.0", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "volume_id": "d89133b6-93f4-4e56-909a-bae2d1fa6a1d", Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"d89133b6-93f4-4e56-909a-bae2d1fa6a1d\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"ea1163b57d574d8c9031fe9c82c96b2c\", \"project_id\": \"2ee62c33d51844a9a90e9a9e640d703b\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004562@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T03:47:36.000000\", \"launched_at\": \"2026-07-05T03:47:36.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-1919702748\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"ac464b70-f08d-447b-aa26-2823b4948fc2\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T03:47:36.000000\", \"updated_at\": \"2026-07-05T03:47:37.000000\"}}" Jul 05 03:47:58.941113 np0000004562 cinder-backup[101413]: }. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 03:47:58.944442 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Restoring backup version 1.0.0 {{(pid=101413) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jul 05 03:47:58.944442 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] _read_metadata started, container name: volumebackups, metadata filename: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1_metadata. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] _read_metadata finished. Metadata: { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "backup_description": null, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "backup_id": "0b139eba-74ef-4b2a-a75f-610492d814c1", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "backup_name": "tempest-VolumesBackupsTest-Backup-792819402", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "created_at": "2026-07-05 03:47:37+00:00", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "objects": [ Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00001": { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "offset": 0 Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00002": { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "offset": 52428800 Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00003": { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "offset": 104857600 Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00004": { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "offset": 157286400 Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00005": { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "offset": 209715200 Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00006": { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "offset": 262144000 Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00007": { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "offset": 314572800 Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00008": { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "offset": 367001600 Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00009": { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "offset": 419430400 Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00010": { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "offset": 471859200 Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00011": { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "offset": 524288000 Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00012": { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "offset": 576716800 Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00013": { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "offset": 629145600 Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00014": { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "offset": 681574400 Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00015": { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "offset": 734003200 Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00016": { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "offset": 786432000 Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00017": { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "offset": 838860800 Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00018": { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "offset": 891289600 Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00019": { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "offset": 943718400 Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00020": { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "offset": 996147200 Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: }, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00021": { Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "length": 25165824, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "offset": 1048576000 Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: } Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: ], Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "parent_id": null, Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "version": "1.0.0", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "volume_id": "d89133b6-93f4-4e56-909a-bae2d1fa6a1d", Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"d89133b6-93f4-4e56-909a-bae2d1fa6a1d\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"ea1163b57d574d8c9031fe9c82c96b2c\", \"project_id\": \"2ee62c33d51844a9a90e9a9e640d703b\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004562@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T03:47:36.000000\", \"launched_at\": \"2026-07-05T03:47:36.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-1919702748\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"ac464b70-f08d-447b-aa26-2823b4948fc2\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T03:47:36.000000\", \"updated_at\": \"2026-07-05T03:47:37.000000\"}}" Jul 05 03:47:58.953208 np0000004562 cinder-backup[101413]: }. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 03:47:58.957429 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] v1 volume backup restore of 0b139eba-74ef-4b2a-a75f-610492d814c1 started. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 05 03:47:58.957429 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] metadata_object_names = ['volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00001', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00002', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00003', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00004', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00005', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00006', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00007', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00008', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00009', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00010', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00011', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00012', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00013', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00014', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00015', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00016', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00017', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00018', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00019', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00020', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00021']. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 05 03:47:58.990587 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] generated object list: ['volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00001', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00002', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00003', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00004', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00005', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00006', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00007', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00008', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00009', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00010', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00011', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00012', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00013', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00014', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00015', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00016', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00017', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00018', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00019', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00020', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00021', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1_metadata', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:47:58.994602 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 0b139eba-74ef-4b2a-a75f-610492d814c1, container: volumebackups, object name: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00001, volume: d89133b6-93f4-4e56-909a-bae2d1fa6a1d. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:47:59.009112 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:47:59.386146 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 0b139eba-74ef-4b2a-a75f-610492d814c1, container: volumebackups, object name: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00002, volume: d89133b6-93f4-4e56-909a-bae2d1fa6a1d. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:47:59.400540 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:47:59.768292 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 0b139eba-74ef-4b2a-a75f-610492d814c1, container: volumebackups, object name: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00003, volume: d89133b6-93f4-4e56-909a-bae2d1fa6a1d. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:47:59.782476 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:00.157529 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 0b139eba-74ef-4b2a-a75f-610492d814c1, container: volumebackups, object name: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00004, volume: d89133b6-93f4-4e56-909a-bae2d1fa6a1d. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:00.170430 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:00.542840 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 0b139eba-74ef-4b2a-a75f-610492d814c1, container: volumebackups, object name: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00005, volume: d89133b6-93f4-4e56-909a-bae2d1fa6a1d. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:00.556942 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:00.580001 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Create backup started, backup: 8a3a2c60-b841-4114-b4c8-b51f77ad36a9 volume: 0f06d164-0954-4852-8f32-422ea1f6201d. Jul 05 03:48:00.584798 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T03:48:00Z,data_timestamp=2026-07-05T03:48:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1324943788',encryption_key_id=None,fail_reason=None,host='np0000004562',id=8a3a2c60-b841-4114-b4c8-b51f77ad36a9,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='d9a227fd10ab442fa1d322fa4e20c6ea',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='016ae708563743cd8cbb2b33ed9082cd',volume_id=0f06d164-0954-4852-8f32-422ea1f6201d) Jul 05 03:48:00.606427 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_d9a227fd10ab442fa1d322fa4e20c6ea {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:48:00.606673 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:48:00.607340 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:48:00.617308 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:48:00.638470 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:48:00.654788 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:48:00.655128 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:48:00.662546 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:48:00.663426 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe3a:a676', 'fe80::e477:baff:fee9:cab5'] Jul 05 03:48:00.663546 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:48:00.663703 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:48:00.663955 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] <== get_connector_properties: return (56ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:48:00.958108 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:48:00.961731 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 0b139eba-74ef-4b2a-a75f-610492d814c1, container: volumebackups, object name: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00006, volume: d89133b6-93f4-4e56-909a-bae2d1fa6a1d. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:00.975467 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:01.167224 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:48:01.167654 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f06d164-0954-4852-8f32-422ea1f6201d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f06d164-0954-4852-8f32-422ea1f6201d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:48:01.167847 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:48:01.351681 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 0b139eba-74ef-4b2a-a75f-610492d814c1, container: volumebackups, object name: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00007, volume: d89133b6-93f4-4e56-909a-bae2d1fa6a1d. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:01.366939 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:01.717782 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.550s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:48:01.718156 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f06d164-0954-4852-8f32-422ea1f6201d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f06d164-0954-4852-8f32-422ea1f6201d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:48:01.722656 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 0b139eba-74ef-4b2a-a75f-610492d814c1, container: volumebackups, object name: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00008, volume: d89133b6-93f4-4e56-909a-bae2d1fa6a1d. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:01.729950 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0f06d164-0954-4852-8f32-422ea1f6201d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:48:01.730220 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0f06d164-0954-4852-8f32-422ea1f6201d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:48:01.730497 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:48:01.736573 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:01.741619 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:48:01.741619 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:01.752643 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0f06d164-0954-4852-8f32-422ea1f6201d] added Jul 05 03:48:01.752643 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:48:01.752643 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:48:01.752643 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:48:01.752643 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:48:01.752643 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:48:01.752643 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:01.752870 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:48:01.753230 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0228(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:48:01.753431 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:48:02.105569 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 0b139eba-74ef-4b2a-a75f-610492d814c1, container: volumebackups, object name: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00009, volume: d89133b6-93f4-4e56-909a-bae2d1fa6a1d. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:02.117977 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:02.484182 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 0b139eba-74ef-4b2a-a75f-610492d814c1, container: volumebackups, object name: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00010, volume: d89133b6-93f4-4e56-909a-bae2d1fa6a1d. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:02.497446 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:02.878811 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:48:02.883085 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 0b139eba-74ef-4b2a-a75f-610492d814c1, container: volumebackups, object name: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00011, volume: d89133b6-93f4-4e56-909a-bae2d1fa6a1d. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-0f06d164-0954-4852-8f32-422ea1f6201d Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:48:02.890221 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:02.900301 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:02.903236 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:02.916515 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:02.916515 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:02.916515 np0000004562 cinder-backup[101413]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d (non-flash) Jul 05 03:48:02.916515 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:02.916515 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:02.916515 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:48:02.916793 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:02.916793 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:02.916793 np0000004562 cinder-backup[101413]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d (non-flash) Jul 05 03:48:02.916793 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:02.916793 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:02.916793 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:48:02.960641 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0f06d164-0954-4852-8f32-422ea1f6201d, portal: 192.168.40.100,3260] Jul 05 03:48:02.960641 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0f06d164-0954-4852-8f32-422ea1f6201d, portal: 192.168.40.100,3260] successful. Jul 05 03:48:02.960641 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:02.972538 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:02.985702 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:02.985702 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:02.985702 np0000004562 cinder-backup[101413]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d (non-flash) Jul 05 03:48:02.985702 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:02.985702 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:02.985702 np0000004562 cinder-backup[101413]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f06d164-0954-4852-8f32-422ea1f6201d (non-flash) Jul 05 03:48:02.985702 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:48:02.986033 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:02.986033 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:02.986033 np0000004562 cinder-backup[101413]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d (non-flash) Jul 05 03:48:02.986033 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:02.986033 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:02.986033 np0000004562 cinder-backup[101413]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f06d164-0954-4852-8f32-422ea1f6201d (non-flash) Jul 05 03:48:02.986033 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:48:02.986406 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0f06d164-0954-4852-8f32-422ea1f6201d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.256s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:48:02.986638 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:48:02.987738 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] HCTL ('12', '-', '-', 0) found on session 209 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:48:02.987961 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Scanning host 12 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:48:03.006846 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Searching for a device in session 209 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:48:03.006846 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f06d164-0954-4852-8f32-422ea1f6201d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f06d164-0954-4852-8f32-422ea1f6201d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:48:03.299618 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 0b139eba-74ef-4b2a-a75f-610492d814c1, container: volumebackups, object name: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00012, volume: d89133b6-93f4-4e56-909a-bae2d1fa6a1d. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:03.312326 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:03.671949 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 0b139eba-74ef-4b2a-a75f-610492d814c1, container: volumebackups, object name: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00013, volume: d89133b6-93f4-4e56-909a-bae2d1fa6a1d. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:03.684935 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:04.048212 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.331s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:48:04.048833 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] <== connect_volume: return (2880ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799236', 'path': '/dev/sdg'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:48:04.048833 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdg {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:48:04.061090 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 0b139eba-74ef-4b2a-a75f-610492d814c1, container: volumebackups, object name: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00014, volume: d89133b6-93f4-4e56-909a-bae2d1fa6a1d. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:04.066029 np0000004562 sudo[152917]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdg Jul 05 03:48:04.066608 np0000004562 sudo[152917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:48:04.077293 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:04.357103 np0000004562 sudo[152917]: pam_unix(sudo:session): session closed for user root Jul 05 03:48:04.446164 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdg" returned: 0 in 0.397s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:48:04.476862 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 0b139eba-74ef-4b2a-a75f-610492d814c1, container: volumebackups, object name: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00015, volume: d89133b6-93f4-4e56-909a-bae2d1fa6a1d. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:04.486326 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] _create_container started, container: volumebackups,backup: 8a3a2c60-b841-4114-b4c8-b51f77ad36a9. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:48:04.494116 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:04.564582 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] generate_object_name_prefix: volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9 {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:48:04.570130 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] starting backup of volume: 0f06d164-0954-4852-8f32-422ea1f6201d, volume size: 1073741824, object names prefix volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:48:04.792742 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:04.959816 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 0b139eba-74ef-4b2a-a75f-610492d814c1, container: volumebackups, object name: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00016, volume: d89133b6-93f4-4e56-909a-bae2d1fa6a1d. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:04.973882 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:05.041621 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:05.041799 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:05.165348 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:05.165689 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:05.459081 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 0b139eba-74ef-4b2a-a75f-610492d814c1, container: volumebackups, object name: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00017, volume: d89133b6-93f4-4e56-909a-bae2d1fa6a1d. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:05.478842 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:05.504994 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:05.864478 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:05.864676 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:05.871698 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 0b139eba-74ef-4b2a-a75f-610492d814c1, container: volumebackups, object name: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00018, volume: d89133b6-93f4-4e56-909a-bae2d1fa6a1d. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:05.892120 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:05.975021 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:05.975173 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:06.252784 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:06.255318 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 0b139eba-74ef-4b2a-a75f-610492d814c1, container: volumebackups, object name: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00019, volume: d89133b6-93f4-4e56-909a-bae2d1fa6a1d. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:06.272994 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:06.513966 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:06.514145 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:06.646310 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 0b139eba-74ef-4b2a-a75f-610492d814c1, container: volumebackups, object name: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00020, volume: d89133b6-93f4-4e56-909a-bae2d1fa6a1d. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:06.662129 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:06.743895 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:06.744109 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:07.068599 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:07.072879 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 0b139eba-74ef-4b2a-a75f-610492d814c1, container: volumebackups, object name: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00021, volume: d89133b6-93f4-4e56-909a-bae2d1fa6a1d. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:07.089171 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:07.282500 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] v1 volume backup restore of 0b139eba-74ef-4b2a-a75f-610492d814c1 finished. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 05 03:48:07.283098 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Restoring volume base metadata {{(pid=101413) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 05 03:48:07.288726 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Excluding field 'display_name' {{(pid=101413) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 05 03:48:07.288908 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Excluding field 'display_description' {{(pid=101413) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 05 03:48:07.296006 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] No metadata of type 'volume-metadata' to restore {{(pid=101413) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 05 03:48:07.296219 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=101413) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 05 03:48:07.296437 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] restore 0b139eba-74ef-4b2a-a75f-610492d814c1 to d89133b6-93f4-4e56-909a-bae2d1fa6a1d finished. {{(pid=101413) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jul 05 03:48:07.502699 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:48:07.510672 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:07.510951 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:07.522407 np0000004562 sudo[153162]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 05 03:48:07.523024 np0000004562 sudo[153162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:48:07.615113 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:07.615277 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:07.798984 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:07.844500 np0000004562 sudo[153162]: pam_unix(sudo:session): session closed for user root Jul 05 03:48:07.846786 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.344s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:48:07.847387 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd89133b6-93f4-4e56-909a-bae2d1fa6a1d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000e063100d', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:48:07.847613 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:48:08.043021 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:08.043177 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:08.144684 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:08.144875 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:08.212009 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.364s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:48:08.213444 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd89133b6-93f4-4e56-909a-bae2d1fa6a1d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:48:08.227385 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:48:08.227385 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:48:08.227385 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:48:08.227385 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:48:08.227385 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:48:08.227385 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a Jul 05 03:48:08.227385 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:48:08.227385 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:08.227385 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:48:08.227385 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:08.227385 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea Jul 05 03:48:08.227385 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:48:08.227385 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:08.227385 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:48:08.227385 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:08.227385 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-0f06d164-0954-4852-8f32-422ea1f6201d Jul 05 03:48:08.227385 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:48:08.227385 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:08.227385 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 Jul 05 03:48:08.227385 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:48:08.227385 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:08.227385 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:48:08.227385 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:08.227385 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d Jul 05 03:48:08.227385 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:48:08.227385 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:08.227385 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:48:08.227385 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:48:08.227385 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:48:08.228316 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:48:08.228316 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:48:08.228316 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:48:08.228895 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:48:08.257587 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:08.257587 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:08.257587 np0000004562 cinder-backup[101413]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d (non-flash) Jul 05 03:48:08.257587 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:08.257587 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:08.257587 np0000004562 cinder-backup[101413]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f06d164-0954-4852-8f32-422ea1f6201d (non-flash) Jul 05 03:48:08.257587 np0000004562 cinder-backup[101413]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:08.257587 np0000004562 cinder-backup[101413]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:08.257587 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:48:08.257825 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:08.257825 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:08.257825 np0000004562 cinder-backup[101413]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d (non-flash) Jul 05 03:48:08.257825 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:08.257825 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:08.257825 np0000004562 cinder-backup[101413]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f06d164-0954-4852-8f32-422ea1f6201d (non-flash) Jul 05 03:48:08.257825 np0000004562 cinder-backup[101413]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:08.257825 np0000004562 cinder-backup[101413]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:08.257825 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:48:08.258004 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea', '197'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d', '206'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f06d164-0954-4852-8f32-422ea1f6201d', '209'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617', '210'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617', '211')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:48:08.258106 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d', '206')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:48:08.259124 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Resulting device map defaultdict(. at 0x72a470242ca0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d'): ({'sdb'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:48:08.259342 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Removing single pathed devices sdb {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:48:08.269893 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Flushing IO for device /dev/sdb {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:48:08.282158 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:48:08.331730 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:08.338127 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:48:08.338322 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:48:08.339437 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:48:08.351865 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:48:08.352080 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:48:08.362478 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:08.395499 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 206, target: iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d, portal: 192.168.40.100,3260] Jul 05 03:48:08.395499 np0000004562 cinder-backup[101413]: Logout of [sid: 206, target: iqn.2023-03.storpool.com:os--volume-d89133b6-93f4-4e56-909a-bae2d1fa6a1d, portal: 192.168.40.100,3260] successful. Jul 05 03:48:08.395499 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:08.411601 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:08.411731 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.200s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:48:08.411905 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] <== disconnect_volume: return (564ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:48:08.571511 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:08.571637 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:08.673001 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:08.673169 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:08.850315 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:09.093517 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:09.093681 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:09.196486 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:09.196676 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:09.415662 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:09.438863 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.manager [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Encryption key ID for volume d89133b6-93f4-4e56-909a-bae2d1fa6a1d already matches encryption key ID in backup 0b139eba-74ef-4b2a-a75f-610492d814c1. {{(pid=101413) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jul 05 03:48:09.455590 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-d065f846-3a9b-40ec-a927-f245ee52c3fa tempest-VolumesBackupsTest-1375540242 None] Finished restoring backup 0b139eba-74ef-4b2a-a75f-610492d814c1 to volume d89133b6-93f4-4e56-909a-bae2d1fa6a1d. Jul 05 03:48:09.626226 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-e4b83f62-6a90-4d5f-bc3e-0a7ecc533eb9 tempest-VolumesBackupsTest-1375540242 None] Delete backup started, backup: 0b139eba-74ef-4b2a-a75f-610492d814c1. Jul 05 03:48:09.636176 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-e4b83f62-6a90-4d5f-bc3e-0a7ecc533eb9 tempest-VolumesBackupsTest-1375540242 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_2ee62c33d51844a9a90e9a9e640d703b {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:48:09.636875 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-e4b83f62-6a90-4d5f-bc3e-0a7ecc533eb9 tempest-VolumesBackupsTest-1375540242 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:48:09.637046 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e4b83f62-6a90-4d5f-bc3e-0a7ecc533eb9 tempest-VolumesBackupsTest-1375540242 None] delete started, backup: 0b139eba-74ef-4b2a-a75f-610492d814c1, container: volumebackups, prefix: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:48:09.678203 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e4b83f62-6a90-4d5f-bc3e-0a7ecc533eb9 tempest-VolumesBackupsTest-1375540242 None] generated object list: ['volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00001', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00002', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00003', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00004', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00005', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00006', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00007', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00008', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00009', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00010', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00011', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00012', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00013', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00014', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00015', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00016', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00017', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00018', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00019', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00020', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00021', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1_metadata', 'volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:48:09.705897 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e4b83f62-6a90-4d5f-bc3e-0a7ecc533eb9 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00001 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:09.709285 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:09.709446 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:09.725621 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e4b83f62-6a90-4d5f-bc3e-0a7ecc533eb9 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00002 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:09.750198 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e4b83f62-6a90-4d5f-bc3e-0a7ecc533eb9 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00003 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:09.773976 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e4b83f62-6a90-4d5f-bc3e-0a7ecc533eb9 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00004 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:09.792857 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e4b83f62-6a90-4d5f-bc3e-0a7ecc533eb9 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00005 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:09.811507 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:09.811507 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:09.836468 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e4b83f62-6a90-4d5f-bc3e-0a7ecc533eb9 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00006 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:09.845881 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:48:09.857203 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e4b83f62-6a90-4d5f-bc3e-0a7ecc533eb9 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00007 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:09.879151 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e4b83f62-6a90-4d5f-bc3e-0a7ecc533eb9 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00008 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:09.899735 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e4b83f62-6a90-4d5f-bc3e-0a7ecc533eb9 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00009 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:09.919656 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e4b83f62-6a90-4d5f-bc3e-0a7ecc533eb9 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00010 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:09.939390 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e4b83f62-6a90-4d5f-bc3e-0a7ecc533eb9 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00011 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:09.958477 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e4b83f62-6a90-4d5f-bc3e-0a7ecc533eb9 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00012 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:09.981123 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e4b83f62-6a90-4d5f-bc3e-0a7ecc533eb9 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00013 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:10.001290 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e4b83f62-6a90-4d5f-bc3e-0a7ecc533eb9 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00014 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:10.023374 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e4b83f62-6a90-4d5f-bc3e-0a7ecc533eb9 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00015 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:10.041187 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:10.051953 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e4b83f62-6a90-4d5f-bc3e-0a7ecc533eb9 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00016 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:10.079937 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e4b83f62-6a90-4d5f-bc3e-0a7ecc533eb9 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00017 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:10.106804 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e4b83f62-6a90-4d5f-bc3e-0a7ecc533eb9 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00018 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:10.130150 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e4b83f62-6a90-4d5f-bc3e-0a7ecc533eb9 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00019 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:10.148775 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e4b83f62-6a90-4d5f-bc3e-0a7ecc533eb9 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00020 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:10.167565 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e4b83f62-6a90-4d5f-bc3e-0a7ecc533eb9 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1-00021 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:10.186044 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e4b83f62-6a90-4d5f-bc3e-0a7ecc533eb9 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1_metadata in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:10.206476 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e4b83f62-6a90-4d5f-bc3e-0a7ecc533eb9 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_d89133b6-93f4-4e56-909a-bae2d1fa6a1d/20260705034741/az_nova_backup_0b139eba-74ef-4b2a-a75f-610492d814c1_sha256file in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:10.206737 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e4b83f62-6a90-4d5f-bc3e-0a7ecc533eb9 tempest-VolumesBackupsTest-1375540242 None] delete 0b139eba-74ef-4b2a-a75f-610492d814c1 finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:48:10.220624 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-e4b83f62-6a90-4d5f-bc3e-0a7ecc533eb9 tempest-VolumesBackupsTest-1375540242 None] Created reservations ['2170b9ca-8573-4bc2-a661-54b2065bc952', 'f71ec4b9-2a22-4efb-bb4d-2631701127a0'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:48:10.235205 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-e4b83f62-6a90-4d5f-bc3e-0a7ecc533eb9 tempest-VolumesBackupsTest-1375540242 None] Delete backup finished, backup 0b139eba-74ef-4b2a-a75f-610492d814c1 deleted. Jul 05 03:48:10.287482 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:10.287702 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:10.384556 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:10.384733 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:10.560391 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:10.808031 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:10.808169 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:10.912265 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:10.912397 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:11.106560 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:11.349194 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:11.349354 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:11.455617 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:11.455801 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:11.634098 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:11.786831 np0000004562 cinder-backup[101413]: DEBUG oslo_service.periodic_task [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:48:11.787003 np0000004562 cinder-backup[101413]: DEBUG cinder.manager [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Notifying Schedulers of capabilities ... {{(pid=101413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:48:11.883120 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:11.883289 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:11.992076 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:11.992231 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:12.014389 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Create backup started, backup: 3bfdddd3-965c-4664-b552-ec36d08425fd volume: c230f60a-d481-4730-ac0b-8ed34f5522a6. Jul 05 03:48:12.022854 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T03:48:11Z,data_timestamp=2026-07-05T03:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-851849097',encryption_key_id=None,fail_reason=None,host='np0000004562',id=3bfdddd3-965c-4664-b552-ec36d08425fd,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='2ee62c33d51844a9a90e9a9e640d703b',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='ea1163b57d574d8c9031fe9c82c96b2c',volume_id=c230f60a-d481-4730-ac0b-8ed34f5522a6) Jul 05 03:48:12.065624 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_2ee62c33d51844a9a90e9a9e640d703b {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:48:12.065933 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:48:12.066642 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:48:12.078937 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:48:12.097738 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:48:12.120904 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:48:12.121188 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:48:12.130346 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:48:12.131462 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe3a:a676', 'fe80::e477:baff:fee9:cab5', 'fe80::f816:3eff:fe96:ac9f', 'fe80::d8a1:37ff:feaa:ab63', 'fe80::f816:3eff:fe3d:f25c'] Jul 05 03:48:12.131650 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:48:12.131820 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:48:12.132103 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] <== get_connector_properties: return (65ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:48:12.190886 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:12.457934 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:12.458119 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:12.557537 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:12.557693 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:12.593779 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:48:12.635691 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:48:12.636156 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c230f60a-d481-4730-ac0b-8ed34f5522a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:48:12.636359 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:48:12.636909 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:48:12.637185 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c230f60a-d481-4730-ac0b-8ed34f5522a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:48:12.650969 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:48:12.651405 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:48:12.651672 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:48:12.665160 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:48:12.665160 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:12.677426 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6] added Jul 05 03:48:12.677426 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:48:12.677426 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:48:12.677426 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:48:12.677426 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:48:12.677426 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:48:12.677426 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:12.677644 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:48:12.678048 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0263(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:48:12.678257 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:48:12.773663 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:13.047665 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:13.047819 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:13.158401 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:13.158602 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:13.370360 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:13.615573 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:13.615796 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:13.679109 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:48:13.691486 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:13.702834 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:13.716621 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:13.716621 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:13.716621 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:13.716621 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:13.716621 np0000004562 cinder-backup[101413]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f06d164-0954-4852-8f32-422ea1f6201d (non-flash) Jul 05 03:48:13.716621 np0000004562 cinder-backup[101413]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:13.716621 np0000004562 cinder-backup[101413]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:13.716621 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:48:13.716980 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:13.716980 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:13.716980 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:13.716980 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:13.716980 np0000004562 cinder-backup[101413]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f06d164-0954-4852-8f32-422ea1f6201d (non-flash) Jul 05 03:48:13.716980 np0000004562 cinder-backup[101413]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:13.716980 np0000004562 cinder-backup[101413]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:13.716980 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:48:13.717294 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:13.717483 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:13.757307 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6, portal: 192.168.40.100,3260] Jul 05 03:48:13.757307 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6, portal: 192.168.40.100,3260] successful. Jul 05 03:48:13.757307 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:13.768137 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:13.783624 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:13.783624 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:13.783624 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:13.783624 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:13.783624 np0000004562 cinder-backup[101413]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f06d164-0954-4852-8f32-422ea1f6201d (non-flash) Jul 05 03:48:13.783624 np0000004562 cinder-backup[101413]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:13.783624 np0000004562 cinder-backup[101413]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:13.783624 np0000004562 cinder-backup[101413]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6 (non-flash) Jul 05 03:48:13.783624 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:48:13.783906 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:13.783906 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:13.783906 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:13.783906 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:13.783906 np0000004562 cinder-backup[101413]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f06d164-0954-4852-8f32-422ea1f6201d (non-flash) Jul 05 03:48:13.783906 np0000004562 cinder-backup[101413]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:13.783906 np0000004562 cinder-backup[101413]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:13.783906 np0000004562 cinder-backup[101413]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6 (non-flash) Jul 05 03:48:13.783906 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:48:13.784163 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.133s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:48:13.784332 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:48:13.785424 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] HCTL ('7', '-', '-', 0) found on session 212 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:48:13.785603 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:48:13.802884 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Searching for a device in session 212 and hctl ['7', '*', '*', 0] yield: None {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:48:13.907293 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:14.154525 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:14.154639 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:14.251688 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:14.251865 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:14.435428 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:14.682799 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:14.683246 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:14.796168 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:14.796827 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:14.804407 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Searching for a device in session 212 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:48:14.804582 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c230f60a-d481-4730-ac0b-8ed34f5522a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:48:14.805618 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.168s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:48:14.805618 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] <== connect_volume: return (2168ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799237', 'path': '/dev/sdb'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:48:14.806283 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:48:14.831461 np0000004562 sudo[153329]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 05 03:48:14.832400 np0000004562 sudo[153329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:48:15.008065 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:15.132833 np0000004562 sudo[153329]: pam_unix(sudo:session): session closed for user root Jul 05 03:48:15.134614 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.329s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:48:15.143327 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] _create_container started, container: volumebackups,backup: 3bfdddd3-965c-4664-b552-ec36d08425fd. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:48:15.173591 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] generate_object_name_prefix: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:48:15.178116 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] starting backup of volume: c230f60a-d481-4730-ac0b-8ed34f5522a6, volume size: 1073741824, object names prefix volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:48:15.257330 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:15.257466 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:15.357192 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:15.357341 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:15.388981 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:15.549670 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:15.644337 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:15.644337 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:15.753387 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:15.753791 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:15.809413 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:15.809582 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:15.910579 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:15.910775 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:15.936126 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:16.093798 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:16.175636 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:16.175812 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:16.277562 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:16.277751 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:16.349395 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:16.349534 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:16.454644 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:16.454841 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:16.461461 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:16.541309 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:16.656983 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:16.657301 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:16.713123 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:16.713301 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:16.718043 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:16.718198 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:16.726416 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:48:16.732223 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:48:16.732298 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:48:16.736998 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:48:16.737146 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:48:16.740121 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:48:16.740350 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:48:16.805407 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:48:16.806157 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] _write_metadata started, container name: volumebackups, metadata filename: volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:48:16.827382 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:16.827495 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:16.832085 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "8a3a2c60-b841-4114-b4c8-b51f77ad36a9",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1324943788",\n "created_at": "2026-07-05 03:48:01+00:00",\n "objects": [\n {\n "volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "0f06d164-0954-4852-8f32-422ea1f6201d",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"0f06d164-0954-4852-8f32-422ea1f6201d\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"b164eb7acb8f4f6caa1ce5a85a398ac0\\", \\"project_id\\": \\"57a311cbff5648e6a0168be82134cf61\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:47:59.000000\\", \\"launched_at\\": \\"2026-07-05T03:48:00.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-72797325\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:47:59.000000\\", \\"updated_at\\": \\"2026-07-05T03:48:01.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:48:16.869882 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] backup 8a3a2c60-b841-4114-b4c8-b51f77ad36a9 finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:48:16.991584 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdg {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:48:17.018987 np0000004562 sudo[153336]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdg Jul 05 03:48:17.019613 np0000004562 sudo[153336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:48:17.053213 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:17.301836 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:17.302016 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:17.343224 np0000004562 sudo[153336]: pam_unix(sudo:session): session closed for user root Jul 05 03:48:17.344891 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdg" returned: 0 in 0.353s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:48:17.345364 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f06d164-0954-4852-8f32-422ea1f6201d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f06d164-0954-4852-8f32-422ea1f6201d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799236', 'path': '/dev/sdg'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:48:17.345596 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:48:17.346014 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:48:17.346318 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f06d164-0954-4852-8f32-422ea1f6201d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f06d164-0954-4852-8f32-422ea1f6201d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:48:17.357542 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:48:17.357542 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:48:17.357542 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:48:17.357542 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:48:17.357542 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:48:17.357542 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a Jul 05 03:48:17.357542 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:48:17.357542 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:17.357542 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:48:17.357542 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:17.357542 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea Jul 05 03:48:17.357542 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:48:17.357542 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:17.357542 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:48:17.357542 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:17.357542 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-0f06d164-0954-4852-8f32-422ea1f6201d Jul 05 03:48:17.357542 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:48:17.357542 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:17.357542 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6 Jul 05 03:48:17.357542 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:48:17.357542 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:17.357542 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 Jul 05 03:48:17.357542 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:48:17.357542 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:17.357542 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:48:17.357542 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:17.357542 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:48:17.357542 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:48:17.357542 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:48:17.358097 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:48:17.358097 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:48:17.358097 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:48:17.358097 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f06d164-0954-4852-8f32-422ea1f6201d', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:48:17.389273 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:17.389273 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:17.389273 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:17.389273 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:17.389273 np0000004562 cinder-backup[101413]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f06d164-0954-4852-8f32-422ea1f6201d (non-flash) Jul 05 03:48:17.389273 np0000004562 cinder-backup[101413]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:17.389273 np0000004562 cinder-backup[101413]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:17.389273 np0000004562 cinder-backup[101413]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6 (non-flash) Jul 05 03:48:17.389273 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:48:17.389548 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:17.389548 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:17.389548 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:17.389548 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:17.389548 np0000004562 cinder-backup[101413]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f06d164-0954-4852-8f32-422ea1f6201d (non-flash) Jul 05 03:48:17.389548 np0000004562 cinder-backup[101413]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:17.389548 np0000004562 cinder-backup[101413]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:17.389548 np0000004562 cinder-backup[101413]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6 (non-flash) Jul 05 03:48:17.389548 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:48:17.389705 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea', '197'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f06d164-0954-4852-8f32-422ea1f6201d', '209'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617', '210'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617', '211'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6', '212')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:48:17.389791 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0f06d164-0954-4852-8f32-422ea1f6201d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f06d164-0954-4852-8f32-422ea1f6201d', '209')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:48:17.390806 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Resulting device map defaultdict(. at 0x72a470325bc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f06d164-0954-4852-8f32-422ea1f6201d'): ({'sdg'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:48:17.391033 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Removing single pathed devices sdg {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:48:17.401199 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Flushing IO for device /dev/sdg {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:48:17.401757 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:17.401915 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:17.410056 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:48:17.464372 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Checking to see if SCSI volumes sdg have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:48:17.464538 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] SCSI volumes sdg have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:48:17.465666 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Checking to see if device paths {'sdg'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:48:17.476399 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Device paths {'sdg'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:48:17.476658 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f06d164-0954-4852-8f32-422ea1f6201d')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:48:17.487742 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:17.517506 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 209, target: iqn.2023-03.storpool.com:os--volume-0f06d164-0954-4852-8f32-422ea1f6201d, portal: 192.168.40.100,3260] Jul 05 03:48:17.517506 np0000004562 cinder-backup[101413]: Logout of [sid: 209, target: iqn.2023-03.storpool.com:os--volume-0f06d164-0954-4852-8f32-422ea1f6201d, portal: 192.168.40.100,3260] successful. Jul 05 03:48:17.517506 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:17.532944 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:17.533217 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.187s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:48:17.533389 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] <== disconnect_volume: return (187ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:48:17.582828 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:17.828082 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:17.828574 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:17.928016 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:17.928212 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:18.102443 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:18.343418 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:18.343579 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:18.443176 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:18.443438 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:18.555827 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-29b2abad-b951-4098-9ec6-d69aedf9c3ef tempest-VolumesBackupsTest-1073117318 None] Create backup finished. backup: 8a3a2c60-b841-4114-b4c8-b51f77ad36a9. Jul 05 03:48:18.638019 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:18.876824 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:18.877363 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:18.974534 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:18.974741 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:19.016873 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-675b1f64-fffe-4518-92c8-409ef9fe2857 tempest-VolumesBackupsTest-1073117318 None] Delete backup started, backup: 8a3a2c60-b841-4114-b4c8-b51f77ad36a9. Jul 05 03:48:19.024617 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-675b1f64-fffe-4518-92c8-409ef9fe2857 tempest-VolumesBackupsTest-1073117318 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_d9a227fd10ab442fa1d322fa4e20c6ea {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:48:19.024975 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-675b1f64-fffe-4518-92c8-409ef9fe2857 tempest-VolumesBackupsTest-1073117318 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:48:19.025146 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-675b1f64-fffe-4518-92c8-409ef9fe2857 tempest-VolumesBackupsTest-1073117318 None] delete started, backup: 8a3a2c60-b841-4114-b4c8-b51f77ad36a9, container: volumebackups, prefix: volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:48:19.069580 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-675b1f64-fffe-4518-92c8-409ef9fe2857 tempest-VolumesBackupsTest-1073117318 None] generated object list: ['volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00001', 'volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00002', 'volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00003', 'volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00004', 'volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00005', 'volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00006', 'volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00007', 'volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00008', 'volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00009', 'volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00010', 'volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00011', 'volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00012', 'volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00013', 'volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00014', 'volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00015', 'volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00016', 'volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00017', 'volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00018', 'volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00019', 'volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00020', 'volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00021', 'volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9_metadata', 'volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:48:19.090402 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-675b1f64-fffe-4518-92c8-409ef9fe2857 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00001 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:19.119641 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-675b1f64-fffe-4518-92c8-409ef9fe2857 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00002 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:19.137901 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-675b1f64-fffe-4518-92c8-409ef9fe2857 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00003 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:19.164734 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-675b1f64-fffe-4518-92c8-409ef9fe2857 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00004 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:19.171526 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:19.184860 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-675b1f64-fffe-4518-92c8-409ef9fe2857 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00005 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:19.205261 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-675b1f64-fffe-4518-92c8-409ef9fe2857 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00006 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:19.221752 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-675b1f64-fffe-4518-92c8-409ef9fe2857 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00007 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:19.242305 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-675b1f64-fffe-4518-92c8-409ef9fe2857 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00008 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:19.261122 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-675b1f64-fffe-4518-92c8-409ef9fe2857 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00009 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:19.277940 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-675b1f64-fffe-4518-92c8-409ef9fe2857 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00010 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:19.295323 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-675b1f64-fffe-4518-92c8-409ef9fe2857 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00011 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:19.311798 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-675b1f64-fffe-4518-92c8-409ef9fe2857 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00012 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:19.328532 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-675b1f64-fffe-4518-92c8-409ef9fe2857 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00013 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:19.345886 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-675b1f64-fffe-4518-92c8-409ef9fe2857 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00014 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:19.362748 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-675b1f64-fffe-4518-92c8-409ef9fe2857 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00015 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:19.379104 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-675b1f64-fffe-4518-92c8-409ef9fe2857 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00016 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:19.395557 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-675b1f64-fffe-4518-92c8-409ef9fe2857 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00017 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:19.412666 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-675b1f64-fffe-4518-92c8-409ef9fe2857 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00018 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:19.422036 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:19.422201 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:19.431683 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-675b1f64-fffe-4518-92c8-409ef9fe2857 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00019 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:19.449739 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-675b1f64-fffe-4518-92c8-409ef9fe2857 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00020 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:19.472657 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-675b1f64-fffe-4518-92c8-409ef9fe2857 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9-00021 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:19.489028 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-675b1f64-fffe-4518-92c8-409ef9fe2857 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9_metadata in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:19.506981 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-675b1f64-fffe-4518-92c8-409ef9fe2857 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_0f06d164-0954-4852-8f32-422ea1f6201d/20260705034804/az_nova_backup_8a3a2c60-b841-4114-b4c8-b51f77ad36a9_sha256file in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:19.507193 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-675b1f64-fffe-4518-92c8-409ef9fe2857 tempest-VolumesBackupsTest-1073117318 None] delete 8a3a2c60-b841-4114-b4c8-b51f77ad36a9 finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:48:19.533821 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:19.534010 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:19.567986 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-675b1f64-fffe-4518-92c8-409ef9fe2857 tempest-VolumesBackupsTest-1073117318 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:48:19.583026 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-675b1f64-fffe-4518-92c8-409ef9fe2857 tempest-VolumesBackupsTest-1073117318 None] Created reservations ['2f831927-5f59-4d38-a310-4f0e8cb92e1f', 'c479dfa2-63a5-4ce7-9b6b-bf19908e88ac'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:48:19.602605 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-675b1f64-fffe-4518-92c8-409ef9fe2857 tempest-VolumesBackupsTest-1073117318 None] Delete backup finished, backup 8a3a2c60-b841-4114-b4c8-b51f77ad36a9 deleted. Jul 05 03:48:19.741107 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:19.982104 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:19.982551 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:20.082825 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:20.083071 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:20.289458 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:20.534080 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:20.534245 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:20.633066 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:20.633239 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:20.807975 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:21.052241 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:21.052749 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:21.159011 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:21.159011 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:21.341626 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:21.367310 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Create backup started, backup: 06cb9f42-018a-483f-8217-fe4a7c1b83ad volume: 7442e3cb-3175-47db-9861-9834880275b6. Jul 05 03:48:21.371776 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T03:48:21Z,data_timestamp=2026-07-05T03:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1770636870',encryption_key_id=None,fail_reason=None,host='np0000004562',id=06cb9f42-018a-483f-8217-fe4a7c1b83ad,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='d9a227fd10ab442fa1d322fa4e20c6ea',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='016ae708563743cd8cbb2b33ed9082cd',volume_id=7442e3cb-3175-47db-9861-9834880275b6) Jul 05 03:48:21.396636 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_d9a227fd10ab442fa1d322fa4e20c6ea {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:48:21.397130 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:48:21.397594 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:48:21.409135 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:48:21.431376 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:48:21.447172 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:48:21.447602 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:48:21.455473 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:48:21.456576 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe3a:a676', 'fe80::e477:baff:fee9:cab5', 'fe80::f816:3eff:fe96:ac9f', 'fe80::d8a1:37ff:feaa:ab63', 'fe80::f816:3eff:fe3d:f25c'] Jul 05 03:48:21.456867 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:48:21.457075 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:48:21.457391 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] <== get_connector_properties: return (59ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:48:21.592347 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:21.592347 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:21.695801 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:21.695801 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:21.731643 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:48:21.908343 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:21.961637 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:48:21.962282 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7442e3cb-3175-47db-9861-9834880275b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:48:21.962664 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:48:21.963279 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:48:21.963654 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7442e3cb-3175-47db-9861-9834880275b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:48:21.974380 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:48:21.975080 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:48:21.975695 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:48:21.986050 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:48:21.986050 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:21.997810 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6] added Jul 05 03:48:21.997810 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:48:21.997810 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:48:21.997810 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:48:21.997810 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:48:21.997810 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:48:21.997810 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:21.997810 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:48:21.997810 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0215(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:48:21.997810 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:48:22.149348 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:22.149348 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:22.252358 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:22.252358 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:22.424966 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:22.666472 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:22.666472 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:22.763231 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:22.763231 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:22.936552 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:22.998299 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:48:23.008615 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:23.019112 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:23.033038 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:23.033038 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:23.033038 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:23.033038 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:23.033038 np0000004562 cinder-backup[101413]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:23.033038 np0000004562 cinder-backup[101413]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:23.033038 np0000004562 cinder-backup[101413]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6 (non-flash) Jul 05 03:48:23.033038 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:48:23.033038 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:23.033038 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:23.033038 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:23.033038 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:23.033038 np0000004562 cinder-backup[101413]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:23.033038 np0000004562 cinder-backup[101413]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:23.033038 np0000004562 cinder-backup[101413]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6 (non-flash) Jul 05 03:48:23.033038 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:48:23.071207 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6, portal: 192.168.40.100,3260] Jul 05 03:48:23.071207 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6, portal: 192.168.40.100,3260] successful. Jul 05 03:48:23.071207 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:23.081134 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:23.095526 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:23.095526 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:23.095526 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:23.095526 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:23.095526 np0000004562 cinder-backup[101413]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:23.095526 np0000004562 cinder-backup[101413]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:23.095526 np0000004562 cinder-backup[101413]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6 (non-flash) Jul 05 03:48:23.095526 np0000004562 cinder-backup[101413]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 (non-flash) Jul 05 03:48:23.095526 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:48:23.095866 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:23.095866 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:23.095866 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:23.095866 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:23.095866 np0000004562 cinder-backup[101413]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:23.095866 np0000004562 cinder-backup[101413]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:23.095866 np0000004562 cinder-backup[101413]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6 (non-flash) Jul 05 03:48:23.095866 np0000004562 cinder-backup[101413]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 (non-flash) Jul 05 03:48:23.095866 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:48:23.096130 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.121s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:48:23.096263 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:48:23.097082 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] HCTL ('12', '-', '-', 0) found on session 213 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:48:23.097209 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Scanning host 12 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:48:23.108009 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Searching for a device in session 213 and hctl ['12', '*', '*', 0] yield: None {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:48:23.175317 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:23.175741 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:23.275035 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:23.275219 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:23.434684 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:23.683816 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:23.684017 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:23.784862 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:23.785029 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:23.961778 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:24.109418 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Searching for a device in session 213 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:48:24.109591 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7442e3cb-3175-47db-9861-9834880275b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:48:24.110206 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.147s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:48:24.110377 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] <== connect_volume: return (2147ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799238', 'path': '/dev/sdg'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:48:24.110668 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdg {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:48:24.135668 np0000004562 sudo[153430]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdg Jul 05 03:48:24.136514 np0000004562 sudo[153430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:48:24.206139 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:24.206547 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:24.309557 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:24.309772 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:24.463212 np0000004562 sudo[153430]: pam_unix(sudo:session): session closed for user root Jul 05 03:48:24.465258 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdg" returned: 0 in 0.354s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:48:24.471481 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] _create_container started, container: volumebackups,backup: 06cb9f42-018a-483f-8217-fe4a7c1b83ad. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:48:24.496318 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] generate_object_name_prefix: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:48:24.501118 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] starting backup of volume: 7442e3cb-3175-47db-9861-9834880275b6, volume size: 1073741824, object names prefix volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:48:24.503636 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:24.662038 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:24.751787 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:24.751918 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:24.855219 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:24.855389 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:24.909126 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:24.909293 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:25.013841 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:25.014201 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:25.044919 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:25.206214 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:25.296362 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:25.296574 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:25.400464 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:25.400709 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:25.466731 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:25.467052 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:25.568183 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:25.568464 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:25.599618 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:25.747522 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:25.847746 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:25.847875 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:25.947405 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:25.947604 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:26.007206 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:26.007351 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:26.040390 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:26.109038 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:26.109156 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:26.159484 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:26.159786 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:26.224421 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:26.224943 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:26.233358 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:48:26.247617 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:48:26.247949 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:48:26.253373 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:48:26.253645 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:48:26.257619 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:48:26.258023 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:48:26.321849 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:26.336740 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:48:26.337652 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] _write_metadata started, container name: volumebackups, metadata filename: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:48:26.364694 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "3bfdddd3-965c-4664-b552-ec36d08425fd",\n "backup_name": "tempest-VolumesBackupsTest-Backup-851849097",\n "created_at": "2026-07-05 03:48:12+00:00",\n "objects": [\n {\n "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "c230f60a-d481-4730-ac0b-8ed34f5522a6",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"c230f60a-d481-4730-ac0b-8ed34f5522a6\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"ea1163b57d574d8c9031fe9c82c96b2c\\", \\"project_id\\": \\"2ee62c33d51844a9a90e9a9e640d703b\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:48:11.000000\\", \\"launched_at\\": \\"2026-07-05T03:48:11.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1169854358\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:48:11.000000\\", \\"updated_at\\": \\"2026-07-05T03:48:12.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:48:26.370070 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] backup 3bfdddd3-965c-4664-b552-ec36d08425fd finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:48:26.490239 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:48:26.510116 np0000004562 sudo[153435]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 05 03:48:26.510751 np0000004562 sudo[153435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:48:26.568940 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:26.569155 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:26.673070 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:26.673207 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:26.818142 np0000004562 sudo[153435]: pam_unix(sudo:session): session closed for user root Jul 05 03:48:26.820005 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.330s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:48:26.820630 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c230f60a-d481-4730-ac0b-8ed34f5522a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799237', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:48:26.820856 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:48:26.821349 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:48:26.821768 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c230f60a-d481-4730-ac0b-8ed34f5522a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:48:26.839863 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:48:26.839863 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:48:26.839863 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:48:26.839863 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:48:26.839863 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:48:26.839863 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a Jul 05 03:48:26.839863 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:48:26.839863 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:26.839863 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:48:26.839863 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:26.839863 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea Jul 05 03:48:26.839863 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:48:26.839863 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:26.839863 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:48:26.839863 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:26.839863 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 Jul 05 03:48:26.839863 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:48:26.839863 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:26.839863 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6 Jul 05 03:48:26.839863 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:48:26.839863 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:26.839863 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 Jul 05 03:48:26.839863 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:48:26.839863 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:26.839863 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:48:26.839863 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:26.839863 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:48:26.839863 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:48:26.839863 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:48:26.840615 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:48:26.840615 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:48:26.840615 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:48:26.840615 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:48:26.865530 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:26.865530 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:26.865530 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:26.865530 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:26.865530 np0000004562 cinder-backup[101413]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:26.865530 np0000004562 cinder-backup[101413]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:26.865530 np0000004562 cinder-backup[101413]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6 (non-flash) Jul 05 03:48:26.865530 np0000004562 cinder-backup[101413]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 (non-flash) Jul 05 03:48:26.865530 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:48:26.866067 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:26.866067 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:26.866067 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:26.866067 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:26.866067 np0000004562 cinder-backup[101413]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:26.866067 np0000004562 cinder-backup[101413]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:26.866067 np0000004562 cinder-backup[101413]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6 (non-flash) Jul 05 03:48:26.866067 np0000004562 cinder-backup[101413]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 (non-flash) Jul 05 03:48:26.866067 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:48:26.866067 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea', '197'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617', '210'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617', '211'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6', '212'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', '213')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:48:26.866290 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6', '212')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:48:26.867449 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Resulting device map defaultdict(. at 0x72a47001cea0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6'): ({'sdb'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:48:26.867756 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Removing single pathed devices sdb {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:48:26.878584 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:26.883635 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Flushing IO for device /dev/sdb {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:48:26.892679 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:48:26.938279 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:48:26.938546 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:48:26.939834 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:48:26.954121 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:48:26.954380 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:48:26.967728 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:27.004984 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 212, target: iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6, portal: 192.168.40.100,3260] Jul 05 03:48:27.004984 np0000004562 cinder-backup[101413]: Logout of [sid: 212, target: iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6, portal: 192.168.40.100,3260] successful. Jul 05 03:48:27.004984 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:27.021287 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:27.021569 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.200s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:48:27.021790 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] <== disconnect_volume: return (201ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:48:27.132527 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:27.132709 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:27.230828 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:27.231239 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:27.399775 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:27.651800 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:27.651994 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:27.753289 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:27.753517 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:27.935085 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:28.038388 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-09900a85-df73-4991-9d1d-483b3431395c tempest-VolumesBackupsTest-1375540242 None] Create backup finished. backup: 3bfdddd3-965c-4664-b552-ec36d08425fd. Jul 05 03:48:28.178416 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:28.178585 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:28.283077 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:28.283511 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:28.458147 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Create backup started, backup: 711cec16-008f-4452-8d66-1c9b2d976cdf volume: c230f60a-d481-4730-ac0b-8ed34f5522a6. Jul 05 03:48:28.462672 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T03:48:28Z,data_timestamp=2026-07-05T03:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1921869999',encryption_key_id=None,fail_reason=None,host='np0000004562',id=711cec16-008f-4452-8d66-1c9b2d976cdf,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(3bfdddd3-965c-4664-b552-ec36d08425fd),parent_id='3bfdddd3-965c-4664-b552-ec36d08425fd',project_id='2ee62c33d51844a9a90e9a9e640d703b',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='ea1163b57d574d8c9031fe9c82c96b2c',volume_id=c230f60a-d481-4730-ac0b-8ed34f5522a6) Jul 05 03:48:28.480847 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:28.488949 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_2ee62c33d51844a9a90e9a9e640d703b {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:48:28.489417 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:48:28.489579 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:48:28.499258 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:48:28.517580 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:48:28.532353 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:48:28.532635 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:48:28.540073 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:48:28.541141 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe3a:a676', 'fe80::e477:baff:fee9:cab5', 'fe80::f816:3eff:fe96:ac9f', 'fe80::d8a1:37ff:feaa:ab63', 'fe80::f816:3eff:fe3d:f25c'] Jul 05 03:48:28.541270 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:48:28.541397 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:48:28.541648 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] <== get_connector_properties: return (51ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:48:28.724521 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:28.724658 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:28.825934 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:28.826121 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:28.862795 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:48:29.039525 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:29.045111 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:48:29.045526 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c230f60a-d481-4730-ac0b-8ed34f5522a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:48:29.045720 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:48:29.046208 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:48:29.046424 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c230f60a-d481-4730-ac0b-8ed34f5522a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:48:29.056623 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:48:29.056948 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:48:29.057146 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:48:29.066270 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:48:29.066270 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:29.075565 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6] added Jul 05 03:48:29.075565 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:48:29.075565 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:48:29.075565 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:48:29.075565 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:48:29.075565 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:48:29.075565 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:29.075828 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:48:29.076071 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0189(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:48:29.076247 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:48:29.277515 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:29.277662 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:29.373295 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:29.373773 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:29.557872 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:29.798666 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:29.798666 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:29.899677 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:29.899677 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:30.078794 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:48:30.083585 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:48:30.090175 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:30.101349 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:30.115161 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:30.115161 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:30.115161 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:30.115161 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:30.115161 np0000004562 cinder-backup[101413]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:30.115161 np0000004562 cinder-backup[101413]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:30.115161 np0000004562 cinder-backup[101413]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 (non-flash) Jul 05 03:48:30.115161 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:48:30.115408 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:30.115408 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:30.115408 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:30.115408 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:30.115408 np0000004562 cinder-backup[101413]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:30.115408 np0000004562 cinder-backup[101413]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:30.115408 np0000004562 cinder-backup[101413]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 (non-flash) Jul 05 03:48:30.115408 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:48:30.149221 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6, portal: 192.168.40.100,3260] Jul 05 03:48:30.149221 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6, portal: 192.168.40.100,3260] successful. Jul 05 03:48:30.149221 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:30.161508 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:30.175366 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:30.175366 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:30.175366 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:30.175366 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:30.175366 np0000004562 cinder-backup[101413]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:30.175366 np0000004562 cinder-backup[101413]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:30.175366 np0000004562 cinder-backup[101413]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 (non-flash) Jul 05 03:48:30.175366 np0000004562 cinder-backup[101413]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6 (non-flash) Jul 05 03:48:30.175366 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:48:30.175755 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:30.175755 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:30.175755 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:30.175755 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:30.175755 np0000004562 cinder-backup[101413]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:30.175755 np0000004562 cinder-backup[101413]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:30.175755 np0000004562 cinder-backup[101413]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 (non-flash) Jul 05 03:48:30.175755 np0000004562 cinder-backup[101413]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6 (non-flash) Jul 05 03:48:30.175755 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:48:30.175990 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.119s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:48:30.176083 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:48:30.176871 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] HCTL ('7', '-', '-', 0) found on session 214 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:48:30.176991 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:48:30.192170 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Searching for a device in session 214 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:48:30.192358 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c230f60a-d481-4730-ac0b-8ed34f5522a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:48:30.340548 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:30.340655 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:30.440976 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:30.441411 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:30.609636 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:30.846782 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:30.846910 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:30.945005 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:30.945139 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:31.113178 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:31.196368 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.150s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:48:31.196512 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] <== connect_volume: return (2150ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799237', 'path': '/dev/sdb'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:48:31.196817 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:48:31.216304 np0000004562 sudo[153534]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 05 03:48:31.217009 np0000004562 sudo[153534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:48:31.359734 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:31.359869 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:31.461206 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:31.461621 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:31.513606 np0000004562 sudo[153534]: pam_unix(sudo:session): session closed for user root Jul 05 03:48:31.515526 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.319s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:48:31.520289 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] _read_sha256file started, container name: volumebackups, sha256 filename: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd_sha256file. {{(pid=101413) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:333}} Jul 05 03:48:31.552371 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] _read_sha256file finished. {{(pid=101413) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:340}} Jul 05 03:48:31.559625 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] _create_container started, container: volumebackups,backup: 711cec16-008f-4452-8d66-1c9b2d976cdf. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:48:31.589207 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] generate_object_name_prefix: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034831/az_nova_backup_711cec16-008f-4452-8d66-1c9b2d976cdf {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:48:31.594434 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] starting backup of volume: c230f60a-d481-4730-ac0b-8ed34f5522a6, volume size: 1073741824, object names prefix volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034831/az_nova_backup_711cec16-008f-4452-8d66-1c9b2d976cdf, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:48:31.639398 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:31.882602 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:31.882862 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:31.980705 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:31.980943 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:32.238487 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:32.483238 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:32.483762 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:32.584805 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:32.584984 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:32.843487 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:33.090871 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:33.091005 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:33.191305 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:33.191448 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:33.455017 np0000004562 cinder-backup[101413]: DEBUG dbcounter [-] [101413] Writing DB stats cinder:SELECT=206,cinder:UPDATE=52,cinder:INSERT=6 {{(pid=101413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:48:33.460774 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:33.719606 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:33.720051 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:33.821468 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:33.821670 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:34.102958 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:34.356647 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:34.356855 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:34.457060 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:34.457250 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:34.728516 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:34.971869 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:34.972084 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:35.077789 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:35.078021 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:35.337942 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:35.581456 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:35.581732 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:35.686346 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:35.686535 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:35.822930 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:35.829213 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:48:35.833846 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:48:35.833995 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:48:35.837171 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:48:35.837299 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:48:35.839707 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:48:35.839916 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034831/az_nova_backup_711cec16-008f-4452-8d66-1c9b2d976cdf_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:48:35.890033 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:48:35.890607 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] _write_metadata started, container name: volumebackups, metadata filename: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034831/az_nova_backup_711cec16-008f-4452-8d66-1c9b2d976cdf_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:48:35.911505 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "711cec16-008f-4452-8d66-1c9b2d976cdf",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1921869999",\n "created_at": "2026-07-05 03:48:28+00:00",\n "objects": [],\n "parent_id": "3bfdddd3-965c-4664-b552-ec36d08425fd",\n "version": "1.0.0",\n "volume_id": "c230f60a-d481-4730-ac0b-8ed34f5522a6",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"c230f60a-d481-4730-ac0b-8ed34f5522a6\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"ea1163b57d574d8c9031fe9c82c96b2c\\", \\"project_id\\": \\"2ee62c33d51844a9a90e9a9e640d703b\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:48:11.000000\\", \\"launched_at\\": \\"2026-07-05T03:48:11.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1169854358\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:48:11.000000\\", \\"updated_at\\": \\"2026-07-05T03:48:28.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:48:35.916134 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] backup 711cec16-008f-4452-8d66-1c9b2d976cdf finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:48:36.036199 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:48:36.042844 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:36.043090 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:36.059298 np0000004562 sudo[153539]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 05 03:48:36.060203 np0000004562 sudo[153539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:48:36.105271 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:36.105538 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:36.115294 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:48:36.122597 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:48:36.122865 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:48:36.127104 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:48:36.127297 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:48:36.130418 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:48:36.130749 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:48:36.190045 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:48:36.190627 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] _write_metadata started, container name: volumebackups, metadata filename: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:48:36.210371 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "06cb9f42-018a-483f-8217-fe4a7c1b83ad",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1770636870",\n "created_at": "2026-07-05 03:48:21+00:00",\n "objects": [\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "7442e3cb-3175-47db-9861-9834880275b6",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"7442e3cb-3175-47db-9861-9834880275b6\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"b164eb7acb8f4f6caa1ce5a85a398ac0\\", \\"project_id\\": \\"57a311cbff5648e6a0168be82134cf61\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:48:20.000000\\", \\"launched_at\\": \\"2026-07-05T03:48:20.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-709573013\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:48:20.000000\\", \\"updated_at\\": \\"2026-07-05T03:48:21.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:48:36.215568 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] backup 06cb9f42-018a-483f-8217-fe4a7c1b83ad finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:48:36.333917 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdg {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:48:36.351471 np0000004562 sudo[153544]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdg Jul 05 03:48:36.351649 np0000004562 sudo[153539]: pam_unix(sudo:session): session closed for user root Jul 05 03:48:36.352105 np0000004562 sudo[153544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:48:36.354002 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.317s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:48:36.354797 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c230f60a-d481-4730-ac0b-8ed34f5522a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799237', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:48:36.355041 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:48:36.355639 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:48:36.356111 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c230f60a-d481-4730-ac0b-8ed34f5522a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:48:36.367239 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:48:36.367239 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:48:36.367239 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:48:36.367239 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:48:36.367239 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:48:36.367239 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a Jul 05 03:48:36.367239 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:48:36.367239 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:36.367239 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:48:36.367239 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:36.367239 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea Jul 05 03:48:36.367239 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:48:36.367239 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:36.367239 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:48:36.367239 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:36.367239 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 Jul 05 03:48:36.367239 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:48:36.367239 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:36.367239 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6 Jul 05 03:48:36.367239 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:48:36.367239 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:36.367239 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 Jul 05 03:48:36.367239 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:48:36.367239 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:36.367239 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:48:36.367239 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:36.367239 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:48:36.367239 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:48:36.367239 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:48:36.367761 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:48:36.367761 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:48:36.367761 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:48:36.367761 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:48:36.390932 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:36.390932 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:36.390932 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:36.390932 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:36.390932 np0000004562 cinder-backup[101413]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:36.390932 np0000004562 cinder-backup[101413]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:36.390932 np0000004562 cinder-backup[101413]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 (non-flash) Jul 05 03:48:36.390932 np0000004562 cinder-backup[101413]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6 (non-flash) Jul 05 03:48:36.390932 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:48:36.391226 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:36.391226 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:36.391226 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:36.391226 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:36.391226 np0000004562 cinder-backup[101413]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:36.391226 np0000004562 cinder-backup[101413]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:36.391226 np0000004562 cinder-backup[101413]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 (non-flash) Jul 05 03:48:36.391226 np0000004562 cinder-backup[101413]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6 (non-flash) Jul 05 03:48:36.391226 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:48:36.391365 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea', '197'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617', '210'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617', '211'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', '213'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6', '214')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:48:36.391423 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6', '214')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:48:36.392354 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Resulting device map defaultdict(. at 0x72a4703267a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6'): ({'sdb'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:48:36.392579 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Removing single pathed devices sdb {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:48:36.402303 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Flushing IO for device /dev/sdb {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:48:36.409992 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:48:36.457131 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:48:36.457295 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:48:36.458531 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:48:36.468515 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:48:36.468763 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:48:36.479393 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:36.511561 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 214, target: iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6, portal: 192.168.40.100,3260] Jul 05 03:48:36.511561 np0000004562 cinder-backup[101413]: Logout of [sid: 214, target: iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6, portal: 192.168.40.100,3260] successful. Jul 05 03:48:36.511561 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:36.527455 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:36.527708 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.172s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:48:36.527864 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] <== disconnect_volume: return (173ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:48:36.645005 np0000004562 sudo[153544]: pam_unix(sudo:session): session closed for user root Jul 05 03:48:36.646956 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdg" returned: 0 in 0.313s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:48:36.647331 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7442e3cb-3175-47db-9861-9834880275b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799238', 'path': '/dev/sdg'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:48:36.647517 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:48:36.647825 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:48:36.648102 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7442e3cb-3175-47db-9861-9834880275b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:48:36.660724 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:48:36.660724 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:48:36.660724 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:48:36.660724 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:48:36.660724 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:48:36.660724 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a Jul 05 03:48:36.660724 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:48:36.660724 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:36.660724 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:48:36.660724 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:36.660724 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea Jul 05 03:48:36.660724 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:48:36.660724 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:36.660724 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:48:36.660724 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:36.660724 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 Jul 05 03:48:36.660724 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:48:36.660724 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:36.660724 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 Jul 05 03:48:36.660724 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:48:36.660724 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:36.660724 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:48:36.660724 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:36.660724 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:48:36.660724 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:48:36.660724 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:48:36.661163 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:48:36.661163 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:48:36.661163 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:48:36.661163 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:48:36.683146 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:36.683146 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:36.683146 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:36.683146 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:36.683146 np0000004562 cinder-backup[101413]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:36.683146 np0000004562 cinder-backup[101413]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:36.683146 np0000004562 cinder-backup[101413]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 (non-flash) Jul 05 03:48:36.683146 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:48:36.683366 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:36.683366 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:36.683366 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:36.683366 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:36.683366 np0000004562 cinder-backup[101413]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:36.683366 np0000004562 cinder-backup[101413]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:36.683366 np0000004562 cinder-backup[101413]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 (non-flash) Jul 05 03:48:36.683366 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:48:36.683576 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea', '197'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617', '210'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617', '211'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', '213')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:48:36.683854 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', '213')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:48:36.684554 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Resulting device map defaultdict(. at 0x72a470545e40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6'): ({'sdg'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:48:36.684759 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Removing single pathed devices sdg {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:48:36.694425 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Flushing IO for device /dev/sdg {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:48:36.700921 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:48:36.751046 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Checking to see if SCSI volumes sdg have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:48:36.751223 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] SCSI volumes sdg have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:48:36.752242 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Checking to see if device paths {'sdg'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:48:36.762220 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Device paths {'sdg'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:48:36.762411 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:48:36.773556 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:36.807554 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 213, target: iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6, portal: 192.168.40.100,3260] Jul 05 03:48:36.807554 np0000004562 cinder-backup[101413]: Logout of [sid: 213, target: iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6, portal: 192.168.40.100,3260] successful. Jul 05 03:48:36.807554 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:36.822186 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:36.822386 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.175s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:48:36.822542 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] <== disconnect_volume: return (174ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:48:37.552131 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-1bd2f68e-01fc-4ec0-b4d2-5688b7bd5d6a tempest-VolumesBackupsTest-1375540242 None] Create backup finished. backup: 711cec16-008f-4452-8d66-1c9b2d976cdf. Jul 05 03:48:37.730436 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Restore backup started, backup: 711cec16-008f-4452-8d66-1c9b2d976cdf volume: c230f60a-d481-4730-ac0b-8ed34f5522a6. Jul 05 03:48:37.742722 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_2ee62c33d51844a9a90e9a9e640d703b {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:48:37.742980 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:48:37.743272 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:48:37.754053 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:48:37.771339 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:48:37.784048 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:48:37.784378 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:48:37.791647 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:48:37.792838 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe3a:a676', 'fe80::e477:baff:fee9:cab5', 'fe80::f816:3eff:fe96:ac9f', 'fe80::d8a1:37ff:feaa:ab63', 'fe80::f816:3eff:fe3d:f25c'] Jul 05 03:48:37.792994 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:48:37.793166 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:48:37.793480 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] <== get_connector_properties: return (49ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:48:37.861547 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:48:37.874111 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-1867f95d-89b3-4b0a-9799-b7bad4389f3e tempest-VolumesBackupsTest-1073117318 None] Create backup finished. backup: 06cb9f42-018a-483f-8217-fe4a7c1b83ad. Jul 05 03:48:38.775203 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Create backup started, backup: 524a0c46-9be5-4c6a-a359-d8fdb9ee8d34 volume: 7442e3cb-3175-47db-9861-9834880275b6. Jul 05 03:48:38.779663 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T03:48:38Z,data_timestamp=2026-07-05T03:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1895459141',encryption_key_id=None,fail_reason=None,host='np0000004562',id=524a0c46-9be5-4c6a-a359-d8fdb9ee8d34,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='57a311cbff5648e6a0168be82134cf61',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='b164eb7acb8f4f6caa1ce5a85a398ac0',volume_id=7442e3cb-3175-47db-9861-9834880275b6) Jul 05 03:48:38.799130 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:48:38.799581 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c230f60a-d481-4730-ac0b-8ed34f5522a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:48:38.799753 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:48:38.800206 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:48:38.800394 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c230f60a-d481-4730-ac0b-8ed34f5522a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:48:38.803965 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_57a311cbff5648e6a0168be82134cf61 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:48:38.804268 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:48:38.804518 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:48:38.811255 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:48:38.811580 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:48:38.811832 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:48:38.818727 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:48:38.823777 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:48:38.823777 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:38.834823 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6] added Jul 05 03:48:38.834823 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:48:38.834823 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:48:38.834823 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:48:38.834823 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:48:38.834823 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:48:38.834823 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:38.835087 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:48:38.835400 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0235(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:48:38.835616 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:48:38.838731 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:48:38.851557 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:48:38.851808 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:48:38.859332 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:48:38.860263 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe3a:a676', 'fe80::e477:baff:fee9:cab5', 'fe80::f816:3eff:fe96:ac9f', 'fe80::d8a1:37ff:feaa:ab63', 'fe80::f816:3eff:fe3d:f25c'] Jul 05 03:48:38.860398 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:48:38.860544 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:48:38.860810 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] <== get_connector_properties: return (56ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:48:39.364769 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:48:39.365228 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7442e3cb-3175-47db-9861-9834880275b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:48:39.365500 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:48:39.836606 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:48:39.847210 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:39.859220 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:39.872371 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:39.872371 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:39.872371 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:39.872371 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:39.872371 np0000004562 cinder-backup[101413]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:39.872371 np0000004562 cinder-backup[101413]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:39.872371 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:48:39.872677 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:39.872677 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:39.872677 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:39.872677 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:39.872677 np0000004562 cinder-backup[101413]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:39.872677 np0000004562 cinder-backup[101413]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:39.872677 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:48:39.909093 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6, portal: 192.168.40.100,3260] Jul 05 03:48:39.909093 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6, portal: 192.168.40.100,3260] successful. Jul 05 03:48:39.909093 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:39.919236 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:39.934907 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:39.934907 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:39.934907 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:39.934907 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:39.934907 np0000004562 cinder-backup[101413]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:39.934907 np0000004562 cinder-backup[101413]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:39.934907 np0000004562 cinder-backup[101413]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6 (non-flash) Jul 05 03:48:39.934907 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:48:39.935193 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:39.935193 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:39.935193 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:39.935193 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:39.935193 np0000004562 cinder-backup[101413]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:39.935193 np0000004562 cinder-backup[101413]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:39.935193 np0000004562 cinder-backup[101413]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6 (non-flash) Jul 05 03:48:39.935193 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:48:39.935432 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.124s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:48:39.935562 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:48:39.936369 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] HCTL ('7', '-', '-', 0) found on session 215 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:48:39.936519 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:48:39.947833 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Searching for a device in session 215 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:48:39.947833 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c230f60a-d481-4730-ac0b-8ed34f5522a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:48:40.949508 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.149s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:48:40.949966 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] <== connect_volume: return (2150ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799237', 'path': '/dev/sdb'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:48:40.950126 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:48:40.957163 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.591s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:48:40.957539 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7442e3cb-3175-47db-9861-9834880275b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:48:40.967951 np0000004562 sudo[153669]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 05 03:48:40.968402 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:48:40.968585 np0000004562 sudo[153669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:48:40.969090 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:48:40.969090 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:48:40.978293 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:48:40.978293 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:40.988061 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6] added Jul 05 03:48:40.988061 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:48:40.988061 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:48:40.988061 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:48:40.988061 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:48:40.988061 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:48:40.988061 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:40.988276 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:48:40.989203 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0197(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:48:40.989405 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:48:41.258765 np0000004562 sudo[153669]: pam_unix(sudo:session): session closed for user root Jul 05 03:48:41.260657 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.310s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:48:41.261101 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] starting restore of backup volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034831/az_nova_backup_711cec16-008f-4452-8d66-1c9b2d976cdf container: volumebackups, to existing volume c230f60a-d481-4730-ac0b-8ed34f5522a6, backup: 711cec16-008f-4452-8d66-1c9b2d976cdf. {{(pid=101413) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jul 05 03:48:41.261301 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] _read_metadata started, container name: volumebackups, metadata filename: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034831/az_nova_backup_711cec16-008f-4452-8d66-1c9b2d976cdf_metadata. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 03:48:41.287231 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] _read_metadata finished. Metadata: { Jul 05 03:48:41.287231 np0000004562 cinder-backup[101413]: "backup_description": null, Jul 05 03:48:41.287231 np0000004562 cinder-backup[101413]: "backup_id": "711cec16-008f-4452-8d66-1c9b2d976cdf", Jul 05 03:48:41.287231 np0000004562 cinder-backup[101413]: "backup_name": "tempest-VolumesBackupsTest-Backup-1921869999", Jul 05 03:48:41.287231 np0000004562 cinder-backup[101413]: "created_at": "2026-07-05 03:48:28+00:00", Jul 05 03:48:41.287231 np0000004562 cinder-backup[101413]: "objects": [], Jul 05 03:48:41.287231 np0000004562 cinder-backup[101413]: "parent_id": "3bfdddd3-965c-4664-b552-ec36d08425fd", Jul 05 03:48:41.287231 np0000004562 cinder-backup[101413]: "version": "1.0.0", Jul 05 03:48:41.287231 np0000004562 cinder-backup[101413]: "volume_id": "c230f60a-d481-4730-ac0b-8ed34f5522a6", Jul 05 03:48:41.287231 np0000004562 cinder-backup[101413]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"c230f60a-d481-4730-ac0b-8ed34f5522a6\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"ea1163b57d574d8c9031fe9c82c96b2c\", \"project_id\": \"2ee62c33d51844a9a90e9a9e640d703b\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004562@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T03:48:11.000000\", \"launched_at\": \"2026-07-05T03:48:11.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-1169854358\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"ac464b70-f08d-447b-aa26-2823b4948fc2\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T03:48:11.000000\", \"updated_at\": \"2026-07-05T03:48:28.000000\"}}" Jul 05 03:48:41.287231 np0000004562 cinder-backup[101413]: }. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 03:48:41.287698 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Restoring backup version 1.0.0 {{(pid=101413) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jul 05 03:48:41.322872 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:48:41.326576 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] _read_metadata started, container name: volumebackups, metadata filename: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd_metadata. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] _read_metadata finished. Metadata: { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "backup_description": null, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "backup_id": "3bfdddd3-965c-4664-b552-ec36d08425fd", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "backup_name": "tempest-VolumesBackupsTest-Backup-851849097", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "created_at": "2026-07-05 03:48:12+00:00", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "objects": [ Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00001": { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "offset": 0 Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: } Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: }, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00002": { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "offset": 52428800 Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: } Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: }, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00003": { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "offset": 104857600 Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: } Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: }, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00004": { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "offset": 157286400 Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: } Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: }, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00005": { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "offset": 209715200 Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: } Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: }, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00006": { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "offset": 262144000 Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: } Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: }, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00007": { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "offset": 314572800 Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: } Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: }, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00008": { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "offset": 367001600 Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: } Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: }, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00009": { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "offset": 419430400 Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: } Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: }, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00010": { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "offset": 471859200 Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: } Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: }, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00011": { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "offset": 524288000 Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: } Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: }, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00012": { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "offset": 576716800 Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: } Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: }, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00013": { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "offset": 629145600 Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: } Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: }, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00014": { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "offset": 681574400 Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: } Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: }, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00015": { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "offset": 734003200 Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: } Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: }, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00016": { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "offset": 786432000 Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: } Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: }, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00017": { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "offset": 838860800 Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: } Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: }, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00018": { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "offset": 891289600 Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: } Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: }, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00019": { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "offset": 943718400 Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: } Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: }, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00020": { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "offset": 996147200 Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: } Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: }, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00021": { Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "length": 25165824, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "offset": 1048576000 Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: } Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: } Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: ], Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "parent_id": null, Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "version": "1.0.0", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "volume_id": "c230f60a-d481-4730-ac0b-8ed34f5522a6", Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"c230f60a-d481-4730-ac0b-8ed34f5522a6\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"ea1163b57d574d8c9031fe9c82c96b2c\", \"project_id\": \"2ee62c33d51844a9a90e9a9e640d703b\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004562@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T03:48:11.000000\", \"launched_at\": \"2026-07-05T03:48:11.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-1169854358\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"ac464b70-f08d-447b-aa26-2823b4948fc2\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T03:48:11.000000\", \"updated_at\": \"2026-07-05T03:48:12.000000\"}}" Jul 05 03:48:41.339354 np0000004562 cinder-backup[101413]: }. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 03:48:41.342523 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] v1 volume backup restore of 3bfdddd3-965c-4664-b552-ec36d08425fd started. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 05 03:48:41.342523 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] metadata_object_names = ['volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00001', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00002', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00003', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00004', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00005', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00006', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00007', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00008', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00009', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00010', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00011', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00012', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00013', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00014', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00015', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00016', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00017', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00018', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00019', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00020', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00021']. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 05 03:48:41.370511 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] generated object list: ['volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00001', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00002', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00003', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00004', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00005', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00006', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00007', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00008', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00009', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00010', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00011', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00012', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00013', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00014', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00015', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00016', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00017', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00018', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00019', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00020', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00021', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd_metadata', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:48:41.373832 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 3bfdddd3-965c-4664-b552-ec36d08425fd, container: volumebackups, object name: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00001, volume: c230f60a-d481-4730-ac0b-8ed34f5522a6. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:41.387035 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:41.769474 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 3bfdddd3-965c-4664-b552-ec36d08425fd, container: volumebackups, object name: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00002, volume: c230f60a-d481-4730-ac0b-8ed34f5522a6. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:41.785221 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:41.990283 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:48:42.005138 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:42.018644 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:42.155269 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:42.155269 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:42.155269 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:42.155269 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:42.155269 np0000004562 cinder-backup[101413]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:42.155269 np0000004562 cinder-backup[101413]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:42.155269 np0000004562 cinder-backup[101413]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6 (non-flash) Jul 05 03:48:42.155269 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:48:42.155677 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:42.155677 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:42.155677 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:42.155677 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:42.155677 np0000004562 cinder-backup[101413]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:42.155677 np0000004562 cinder-backup[101413]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:42.155677 np0000004562 cinder-backup[101413]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6 (non-flash) Jul 05 03:48:42.155677 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:48:42.158450 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 3bfdddd3-965c-4664-b552-ec36d08425fd, container: volumebackups, object name: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00003, volume: c230f60a-d481-4730-ac0b-8ed34f5522a6. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:42.172058 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:42.194184 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6, portal: 192.168.40.100,3260] Jul 05 03:48:42.194184 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6, portal: 192.168.40.100,3260] successful. Jul 05 03:48:42.194184 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:42.205517 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:42.221349 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:42.221349 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:42.221349 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:42.221349 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:42.221349 np0000004562 cinder-backup[101413]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:42.221349 np0000004562 cinder-backup[101413]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:42.221349 np0000004562 cinder-backup[101413]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6 (non-flash) Jul 05 03:48:42.221349 np0000004562 cinder-backup[101413]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 (non-flash) Jul 05 03:48:42.221349 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:48:42.221758 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:42.221758 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:42.221758 np0000004562 cinder-backup[101413]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:42.221758 np0000004562 cinder-backup[101413]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb3d3fea-056b-4f85-a584-513eef82ab0a (non-flash) Jul 05 03:48:42.221758 np0000004562 cinder-backup[101413]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:42.221758 np0000004562 cinder-backup[101413]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:42.221758 np0000004562 cinder-backup[101413]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6 (non-flash) Jul 05 03:48:42.221758 np0000004562 cinder-backup[101413]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 (non-flash) Jul 05 03:48:42.221758 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:48:42.221990 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.253s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:48:42.222078 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:48:42.223030 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] HCTL ('12', '-', '-', 0) found on session 216 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:48:42.223163 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Scanning host 12 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:48:42.235910 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Searching for a device in session 216 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:48:42.236127 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7442e3cb-3175-47db-9861-9834880275b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:48:42.542943 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 3bfdddd3-965c-4664-b552-ec36d08425fd, container: volumebackups, object name: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00004, volume: c230f60a-d481-4730-ac0b-8ed34f5522a6. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:42.556382 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:42.920221 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 3bfdddd3-965c-4664-b552-ec36d08425fd, container: volumebackups, object name: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00005, volume: c230f60a-d481-4730-ac0b-8ed34f5522a6. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:42.933759 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:43.301471 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.345s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:48:43.302004 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] <== connect_volume: return (3935ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799238', 'path': '/dev/sdg'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:48:43.302004 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdg {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:48:43.314168 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 3bfdddd3-965c-4664-b552-ec36d08425fd, container: volumebackups, object name: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00006, volume: c230f60a-d481-4730-ac0b-8ed34f5522a6. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:43.318219 np0000004562 sudo[153719]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdg Jul 05 03:48:43.318839 np0000004562 sudo[153719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:48:43.329652 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:43.624168 np0000004562 sudo[153719]: pam_unix(sudo:session): session closed for user root Jul 05 03:48:43.700431 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdg" returned: 0 in 0.398s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:48:43.732028 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 3bfdddd3-965c-4664-b552-ec36d08425fd, container: volumebackups, object name: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00007, volume: c230f60a-d481-4730-ac0b-8ed34f5522a6. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:43.742302 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] _create_container started, container: volumebackups,backup: 524a0c46-9be5-4c6a-a359-d8fdb9ee8d34. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:48:43.749754 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:43.774867 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] generate_object_name_prefix: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34 {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:48:43.779351 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] starting backup of volume: 7442e3cb-3175-47db-9861-9834880275b6, volume size: 1073741824, object names prefix volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:48:43.977548 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:44.112381 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 3bfdddd3-965c-4664-b552-ec36d08425fd, container: volumebackups, object name: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00008, volume: c230f60a-d481-4730-ac0b-8ed34f5522a6. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:44.125736 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:44.221050 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:44.221219 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:44.321239 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:44.321694 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:44.575060 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 3bfdddd3-965c-4664-b552-ec36d08425fd, container: volumebackups, object name: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00009, volume: c230f60a-d481-4730-ac0b-8ed34f5522a6. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:44.593516 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:44.612915 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:44.971073 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:44.971201 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:44.974878 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 3bfdddd3-965c-4664-b552-ec36d08425fd, container: volumebackups, object name: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00010, volume: c230f60a-d481-4730-ac0b-8ed34f5522a6. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:44.991974 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:45.077276 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:45.077429 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:45.381270 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:45.383957 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 3bfdddd3-965c-4664-b552-ec36d08425fd, container: volumebackups, object name: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00011, volume: c230f60a-d481-4730-ac0b-8ed34f5522a6. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:45.398792 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:45.623285 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:45.623446 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:45.783197 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 3bfdddd3-965c-4664-b552-ec36d08425fd, container: volumebackups, object name: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00012, volume: c230f60a-d481-4730-ac0b-8ed34f5522a6. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:45.797302 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:45.855484 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:45.855688 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:46.156898 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:46.162305 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 3bfdddd3-965c-4664-b552-ec36d08425fd, container: volumebackups, object name: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00013, volume: c230f60a-d481-4730-ac0b-8ed34f5522a6. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:46.181879 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:46.397150 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:46.397562 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:46.546855 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:46.547030 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:46.550701 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 3bfdddd3-965c-4664-b552-ec36d08425fd, container: volumebackups, object name: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00014, volume: c230f60a-d481-4730-ac0b-8ed34f5522a6. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:46.569702 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:46.708786 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:46.945450 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 3bfdddd3-965c-4664-b552-ec36d08425fd, container: volumebackups, object name: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00015, volume: c230f60a-d481-4730-ac0b-8ed34f5522a6. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:46.959266 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:46.959363 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:46.959562 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:47.063536 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:47.063779 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:47.370414 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:47.373978 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 3bfdddd3-965c-4664-b552-ec36d08425fd, container: volumebackups, object name: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00016, volume: c230f60a-d481-4730-ac0b-8ed34f5522a6. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:47.389230 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:47.617661 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:47.618169 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:47.761413 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 3bfdddd3-965c-4664-b552-ec36d08425fd, container: volumebackups, object name: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00017, volume: c230f60a-d481-4730-ac0b-8ed34f5522a6. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:47.776165 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:47.834704 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:47.834860 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:48.033371 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:48.165357 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 3bfdddd3-965c-4664-b552-ec36d08425fd, container: volumebackups, object name: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00018, volume: c230f60a-d481-4730-ac0b-8ed34f5522a6. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:48.182736 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:48.283016 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:48.283016 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:48.398885 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:48.398885 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:48.639369 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 3bfdddd3-965c-4664-b552-ec36d08425fd, container: volumebackups, object name: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00019, volume: c230f60a-d481-4730-ac0b-8ed34f5522a6. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:48.653590 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:48.677151 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:49.035978 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:49.036173 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:49.040932 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 3bfdddd3-965c-4664-b552-ec36d08425fd, container: volumebackups, object name: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00020, volume: c230f60a-d481-4730-ac0b-8ed34f5522a6. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:49.061698 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:49.150310 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:49.150664 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:49.449663 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:49.452844 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] restoring object. backup: 3bfdddd3-965c-4664-b552-ec36d08425fd, container: volumebackups, object name: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00021, volume: c230f60a-d481-4730-ac0b-8ed34f5522a6. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:48:49.464784 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:48:49.649249 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] v1 volume backup restore of 3bfdddd3-965c-4664-b552-ec36d08425fd finished. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 05 03:48:49.649597 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Restoring volume base metadata {{(pid=101413) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 05 03:48:49.655189 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Excluding field 'display_name' {{(pid=101413) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 05 03:48:49.655412 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Excluding field 'display_description' {{(pid=101413) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 05 03:48:49.660154 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] No metadata of type 'volume-metadata' to restore {{(pid=101413) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 05 03:48:49.660534 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=101413) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 05 03:48:49.660878 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] _read_metadata started, container name: volumebackups, metadata filename: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034831/az_nova_backup_711cec16-008f-4452-8d66-1c9b2d976cdf_metadata. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 03:48:49.675523 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] _read_metadata finished. Metadata: { Jul 05 03:48:49.675523 np0000004562 cinder-backup[101413]: "backup_description": null, Jul 05 03:48:49.675523 np0000004562 cinder-backup[101413]: "backup_id": "711cec16-008f-4452-8d66-1c9b2d976cdf", Jul 05 03:48:49.675523 np0000004562 cinder-backup[101413]: "backup_name": "tempest-VolumesBackupsTest-Backup-1921869999", Jul 05 03:48:49.675523 np0000004562 cinder-backup[101413]: "created_at": "2026-07-05 03:48:28+00:00", Jul 05 03:48:49.675523 np0000004562 cinder-backup[101413]: "objects": [], Jul 05 03:48:49.675523 np0000004562 cinder-backup[101413]: "parent_id": "3bfdddd3-965c-4664-b552-ec36d08425fd", Jul 05 03:48:49.675523 np0000004562 cinder-backup[101413]: "version": "1.0.0", Jul 05 03:48:49.675523 np0000004562 cinder-backup[101413]: "volume_id": "c230f60a-d481-4730-ac0b-8ed34f5522a6", Jul 05 03:48:49.675523 np0000004562 cinder-backup[101413]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"c230f60a-d481-4730-ac0b-8ed34f5522a6\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"ea1163b57d574d8c9031fe9c82c96b2c\", \"project_id\": \"2ee62c33d51844a9a90e9a9e640d703b\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004562@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T03:48:11.000000\", \"launched_at\": \"2026-07-05T03:48:11.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-1169854358\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"ac464b70-f08d-447b-aa26-2823b4948fc2\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T03:48:11.000000\", \"updated_at\": \"2026-07-05T03:48:28.000000\"}}" Jul 05 03:48:49.675523 np0000004562 cinder-backup[101413]: }. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 03:48:49.675987 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] v1 volume backup restore of 711cec16-008f-4452-8d66-1c9b2d976cdf started. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 05 03:48:49.676230 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] metadata_object_names = []. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 05 03:48:49.690828 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:49.691095 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:49.728082 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] generated object list: ['volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034831/az_nova_backup_711cec16-008f-4452-8d66-1c9b2d976cdf_metadata', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034831/az_nova_backup_711cec16-008f-4452-8d66-1c9b2d976cdf_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:48:49.728082 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] v1 volume backup restore of 711cec16-008f-4452-8d66-1c9b2d976cdf finished. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 05 03:48:49.728082 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Restoring volume base metadata {{(pid=101413) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 05 03:48:49.735800 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Excluding field 'display_name' {{(pid=101413) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 05 03:48:49.736050 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Excluding field 'display_description' {{(pid=101413) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 05 03:48:49.738733 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] No metadata of type 'volume-metadata' to restore {{(pid=101413) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 05 03:48:49.738898 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=101413) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 05 03:48:49.739049 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] restore 711cec16-008f-4452-8d66-1c9b2d976cdf to c230f60a-d481-4730-ac0b-8ed34f5522a6 finished. {{(pid=101413) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jul 05 03:48:49.976390 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:48:49.983676 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:49.983997 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:50.000514 np0000004562 sudo[153839]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 05 03:48:50.001625 np0000004562 sudo[153839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:48:50.167821 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:50.326699 np0000004562 sudo[153839]: pam_unix(sudo:session): session closed for user root Jul 05 03:48:50.328607 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.352s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:48:50.329313 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c230f60a-d481-4730-ac0b-8ed34f5522a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799237', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:48:50.329535 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:48:50.413795 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:50.413975 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:50.517740 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:50.517931 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:50.690695 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:50.929799 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:50.929963 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:50.984883 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.655s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:48:50.985262 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c230f60a-d481-4730-ac0b-8ed34f5522a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:48:50.995688 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:48:50.995688 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:48:50.995688 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:48:50.995688 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:48:50.995688 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:48:50.995688 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea Jul 05 03:48:50.995688 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:48:50.995688 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:50.995688 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:48:50.995688 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:50.995688 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 Jul 05 03:48:50.995688 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:48:50.995688 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:50.995688 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6 Jul 05 03:48:50.995688 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:48:50.995688 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:50.995688 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 Jul 05 03:48:50.995688 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:48:50.995688 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:50.995688 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:48:50.995688 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:50.995688 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:48:50.995688 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:48:50.995688 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:48:50.996341 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:48:50.996341 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:48:50.996341 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:48:50.996341 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:48:51.019939 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:51.019939 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:51.019939 np0000004562 cinder-backup[101413]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:51.019939 np0000004562 cinder-backup[101413]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:51.019939 np0000004562 cinder-backup[101413]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6 (non-flash) Jul 05 03:48:51.019939 np0000004562 cinder-backup[101413]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 (non-flash) Jul 05 03:48:51.019939 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:48:51.020311 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:51.020311 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:51.020311 np0000004562 cinder-backup[101413]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:51.020311 np0000004562 cinder-backup[101413]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617 (non-flash) Jul 05 03:48:51.020311 np0000004562 cinder-backup[101413]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6 (non-flash) Jul 05 03:48:51.020311 np0000004562 cinder-backup[101413]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 (non-flash) Jul 05 03:48:51.020311 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:48:51.020311 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea', '197'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617', '210'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10b85744-06aa-4b9c-ac35-e3ad651f7617', '211'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6', '215'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', '216')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:48:51.020639 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6', '215')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:48:51.021615 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Resulting device map defaultdict(. at 0x72a4702407c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6'): ({'sdb'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:48:51.021881 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Removing single pathed devices sdb {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:48:51.031440 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:51.031566 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:51.033618 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Flushing IO for device /dev/sdb {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:48:51.041135 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:48:51.108405 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:48:51.108562 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:48:51.109545 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:48:51.120964 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:48:51.121169 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:48:51.131161 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:51.188979 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 215, target: iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6, portal: 192.168.40.100,3260] Jul 05 03:48:51.188979 np0000004562 cinder-backup[101413]: Logout of [sid: 215, target: iqn.2023-03.storpool.com:os--volume-c230f60a-d481-4730-ac0b-8ed34f5522a6, portal: 192.168.40.100,3260] successful. Jul 05 03:48:51.188979 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:51.207327 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:51.207606 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.223s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:48:51.207791 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] <== disconnect_volume: return (878ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:48:51.241572 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:51.487880 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:51.488133 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:51.586055 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:51.586255 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:51.767653 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:52.008641 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:52.008817 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:52.104239 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:52.104239 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:52.220126 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.manager [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Encryption key ID for volume c230f60a-d481-4730-ac0b-8ed34f5522a6 already matches encryption key ID in backup 711cec16-008f-4452-8d66-1c9b2d976cdf. {{(pid=101413) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jul 05 03:48:52.230072 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-79fb7d42-def0-42d5-bc9a-f4fcd078ff2c tempest-VolumesBackupsTest-1375540242 None] Finished restoring backup 711cec16-008f-4452-8d66-1c9b2d976cdf to volume c230f60a-d481-4730-ac0b-8ed34f5522a6. Jul 05 03:48:52.281952 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:52.519928 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:52.520088 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:52.616291 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:52.616482 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:52.784554 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:53.024971 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:53.024971 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:53.089768 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-c9bfba8d-6325-46ef-9418-6b90d49092a4 tempest-VolumesBackupsTest-1375540242 None] Delete backup started, backup: 711cec16-008f-4452-8d66-1c9b2d976cdf. Jul 05 03:48:53.096683 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-c9bfba8d-6325-46ef-9418-6b90d49092a4 tempest-VolumesBackupsTest-1375540242 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_2ee62c33d51844a9a90e9a9e640d703b {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:48:53.096865 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-c9bfba8d-6325-46ef-9418-6b90d49092a4 tempest-VolumesBackupsTest-1375540242 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:48:53.097013 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c9bfba8d-6325-46ef-9418-6b90d49092a4 tempest-VolumesBackupsTest-1375540242 None] delete started, backup: 711cec16-008f-4452-8d66-1c9b2d976cdf, container: volumebackups, prefix: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034831/az_nova_backup_711cec16-008f-4452-8d66-1c9b2d976cdf. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:48:53.120975 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:53.121131 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:53.148945 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c9bfba8d-6325-46ef-9418-6b90d49092a4 tempest-VolumesBackupsTest-1375540242 None] generated object list: ['volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034831/az_nova_backup_711cec16-008f-4452-8d66-1c9b2d976cdf_metadata', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034831/az_nova_backup_711cec16-008f-4452-8d66-1c9b2d976cdf_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:48:53.156858 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:48:53.167618 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c9bfba8d-6325-46ef-9418-6b90d49092a4 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034831/az_nova_backup_711cec16-008f-4452-8d66-1c9b2d976cdf_metadata in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:53.186204 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c9bfba8d-6325-46ef-9418-6b90d49092a4 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034831/az_nova_backup_711cec16-008f-4452-8d66-1c9b2d976cdf_sha256file in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:53.186458 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c9bfba8d-6325-46ef-9418-6b90d49092a4 tempest-VolumesBackupsTest-1375540242 None] delete 711cec16-008f-4452-8d66-1c9b2d976cdf finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:48:53.202839 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-c9bfba8d-6325-46ef-9418-6b90d49092a4 tempest-VolumesBackupsTest-1375540242 None] Created reservations ['f1545ea5-9e18-4bed-92ef-285824790dc5', 'f0798239-7749-46ed-af32-0e5a5b7cc5c1'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:48:53.229817 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-c9bfba8d-6325-46ef-9418-6b90d49092a4 tempest-VolumesBackupsTest-1375540242 None] Delete backup finished, backup 711cec16-008f-4452-8d66-1c9b2d976cdf deleted. Jul 05 03:48:53.339613 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:53.585947 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:53.586068 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:53.683974 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:53.684749 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:53.862148 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:54.106436 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:54.106566 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:54.144129 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-e7e38126-5cc1-4aa9-8418-8169f65ba976 tempest-VolumesBackupsTest-1375540242 None] Delete backup started, backup: 3bfdddd3-965c-4664-b552-ec36d08425fd. Jul 05 03:48:54.146699 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-e7e38126-5cc1-4aa9-8418-8169f65ba976 tempest-VolumesBackupsTest-1375540242 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_2ee62c33d51844a9a90e9a9e640d703b {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:48:54.146999 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-e7e38126-5cc1-4aa9-8418-8169f65ba976 tempest-VolumesBackupsTest-1375540242 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:48:54.147147 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e7e38126-5cc1-4aa9-8418-8169f65ba976 tempest-VolumesBackupsTest-1375540242 None] delete started, backup: 3bfdddd3-965c-4664-b552-ec36d08425fd, container: volumebackups, prefix: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:48:54.181981 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e7e38126-5cc1-4aa9-8418-8169f65ba976 tempest-VolumesBackupsTest-1375540242 None] generated object list: ['volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00001', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00002', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00003', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00004', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00005', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00006', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00007', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00008', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00009', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00010', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00011', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00012', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00013', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00014', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00015', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00016', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00017', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00018', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00019', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00020', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00021', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd_metadata', 'volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:48:54.201518 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e7e38126-5cc1-4aa9-8418-8169f65ba976 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00001 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:54.207946 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:54.208295 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:54.249352 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e7e38126-5cc1-4aa9-8418-8169f65ba976 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00002 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:54.258312 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:48:54.267929 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e7e38126-5cc1-4aa9-8418-8169f65ba976 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00003 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:54.287092 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e7e38126-5cc1-4aa9-8418-8169f65ba976 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00004 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:54.308215 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e7e38126-5cc1-4aa9-8418-8169f65ba976 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00005 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:54.329507 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e7e38126-5cc1-4aa9-8418-8169f65ba976 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00006 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:54.349661 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e7e38126-5cc1-4aa9-8418-8169f65ba976 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00007 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:54.370632 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e7e38126-5cc1-4aa9-8418-8169f65ba976 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00008 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:54.390128 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e7e38126-5cc1-4aa9-8418-8169f65ba976 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00009 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:54.409197 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e7e38126-5cc1-4aa9-8418-8169f65ba976 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00010 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:54.430664 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e7e38126-5cc1-4aa9-8418-8169f65ba976 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00011 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:54.442129 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:54.448213 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e7e38126-5cc1-4aa9-8418-8169f65ba976 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00012 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:54.477682 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e7e38126-5cc1-4aa9-8418-8169f65ba976 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00013 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:54.494478 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e7e38126-5cc1-4aa9-8418-8169f65ba976 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00014 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:54.514518 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e7e38126-5cc1-4aa9-8418-8169f65ba976 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00015 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:54.531446 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e7e38126-5cc1-4aa9-8418-8169f65ba976 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00016 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:54.553124 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e7e38126-5cc1-4aa9-8418-8169f65ba976 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00017 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:54.574188 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e7e38126-5cc1-4aa9-8418-8169f65ba976 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00018 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:54.595718 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e7e38126-5cc1-4aa9-8418-8169f65ba976 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00019 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:54.613022 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e7e38126-5cc1-4aa9-8418-8169f65ba976 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00020 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:54.630878 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e7e38126-5cc1-4aa9-8418-8169f65ba976 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd-00021 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:54.648419 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e7e38126-5cc1-4aa9-8418-8169f65ba976 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd_metadata in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:54.664385 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e7e38126-5cc1-4aa9-8418-8169f65ba976 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_c230f60a-d481-4730-ac0b-8ed34f5522a6/20260705034815/az_nova_backup_3bfdddd3-965c-4664-b552-ec36d08425fd_sha256file in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:48:54.664579 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e7e38126-5cc1-4aa9-8418-8169f65ba976 tempest-VolumesBackupsTest-1375540242 None] delete 3bfdddd3-965c-4664-b552-ec36d08425fd finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:48:54.676193 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-e7e38126-5cc1-4aa9-8418-8169f65ba976 tempest-VolumesBackupsTest-1375540242 None] Created reservations ['95948e93-fbd5-4ae2-a34c-fc728d16ad04', 'cbd05ab2-91dd-43ef-8df8-dd3e73396d7f'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:48:54.687162 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:54.687283 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:54.689168 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-e7e38126-5cc1-4aa9-8418-8169f65ba976 tempest-VolumesBackupsTest-1375540242 None] Delete backup finished, backup 3bfdddd3-965c-4664-b552-ec36d08425fd deleted. Jul 05 03:48:54.782243 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:54.782384 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:54.950077 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:55.191445 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:55.191607 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:55.288552 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:55.288831 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:55.472040 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:55.716503 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:55.716682 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:55.813986 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:55.814156 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:55.904430 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:48:56.020854 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:48:56.021239 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:48:56.085313 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] backup MD5 for volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:48:56.085486 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:48:56.092912 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:48:56.099461 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:48:56.099722 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:48:56.104253 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:48:56.104477 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:48:56.108585 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:48:56.108906 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:48:56.165153 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:48:56.165942 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] _write_metadata started, container name: volumebackups, metadata filename: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:48:56.191580 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "524a0c46-9be5-4c6a-a359-d8fdb9ee8d34",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1895459141",\n "created_at": "2026-07-05 03:48:39+00:00",\n "objects": [\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "7442e3cb-3175-47db-9861-9834880275b6",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"7442e3cb-3175-47db-9861-9834880275b6\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"b164eb7acb8f4f6caa1ce5a85a398ac0\\", \\"project_id\\": \\"57a311cbff5648e6a0168be82134cf61\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:48:20.000000\\", \\"launched_at\\": \\"2026-07-05T03:48:20.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-709573013\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:48:20.000000\\", \\"updated_at\\": \\"2026-07-05T03:48:39.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:48:56.196306 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] backup 524a0c46-9be5-4c6a-a359-d8fdb9ee8d34 finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:48:56.317518 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdg {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:48:56.335861 np0000004562 sudo[154006]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdg Jul 05 03:48:56.336504 np0000004562 sudo[154006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:48:56.643447 np0000004562 sudo[154006]: pam_unix(sudo:session): session closed for user root Jul 05 03:48:56.647754 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdg" returned: 0 in 0.330s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:48:56.648229 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7442e3cb-3175-47db-9861-9834880275b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799238', 'path': '/dev/sdg'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:48:56.649209 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:48:56.652466 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Create backup started, backup: 43a13ec7-8bb2-4118-96f0-671b8f175e1f volume: b5113927-f7d6-4561-bd3f-c758db6d8325. Jul 05 03:48:56.656838 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T03:48:56Z,data_timestamp=2026-07-05T03:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-110875073',encryption_key_id=None,fail_reason=None,host='np0000004562',id=43a13ec7-8bb2-4118-96f0-671b8f175e1f,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='2ee62c33d51844a9a90e9a9e640d703b',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='ea1163b57d574d8c9031fe9c82c96b2c',volume_id=b5113927-f7d6-4561-bd3f-c758db6d8325) Jul 05 03:48:56.683465 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_2ee62c33d51844a9a90e9a9e640d703b {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:48:56.683608 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:48:56.683885 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:48:56.693949 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:48:56.710754 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:48:56.723586 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:48:56.723823 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:48:56.731745 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:48:56.732616 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe3a:a676', 'fe80::e477:baff:fee9:cab5'] Jul 05 03:48:56.732775 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:48:56.732906 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:48:56.733148 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] <== get_connector_properties: return (49ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:48:57.236815 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:48:57.237315 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5113927-f7d6-4561-bd3f-c758db6d8325', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:48:57.237415 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:48:59.420495 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.772s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:48:59.420878 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7442e3cb-3175-47db-9861-9834880275b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:48:59.430573 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:48:59.430573 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:48:59.430573 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:48:59.430573 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:48:59.430573 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:48:59.430573 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea Jul 05 03:48:59.430573 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:48:59.430573 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:59.430573 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:48:59.430573 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:59.430573 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 Jul 05 03:48:59.430573 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:48:59.430573 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:59.430573 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:48:59.430573 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:59.430573 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 Jul 05 03:48:59.430573 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:48:59.430573 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:48:59.430573 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:48:59.430573 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:48:59.430573 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:48:59.430573 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:48:59.430573 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:48:59.430573 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:48:59.431139 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:48:59.452858 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:59.452858 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:59.452858 np0000004562 cinder-backup[101413]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 (non-flash) Jul 05 03:48:59.452858 np0000004562 cinder-backup[101413]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:48:59.452858 np0000004562 cinder-backup[101413]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:48:59.452858 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:48:59.453071 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:59.453071 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:48:59.453071 np0000004562 cinder-backup[101413]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 (non-flash) Jul 05 03:48:59.453071 np0000004562 cinder-backup[101413]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:48:59.453071 np0000004562 cinder-backup[101413]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:48:59.453071 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:48:59.453251 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea', '197'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', '216'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9', '217'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9', '218')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:48:59.453402 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', '216')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:48:59.454258 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Resulting device map defaultdict(. at 0x72a46fe614e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6'): ({'sdg'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:48:59.454506 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Removing single pathed devices sdg {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:48:59.465631 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Flushing IO for device /dev/sdg {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:48:59.474560 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:48:59.527005 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Checking to see if SCSI volumes sdg have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:48:59.527136 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] SCSI volumes sdg have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:48:59.528079 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Checking to see if device paths {'sdg'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:48:59.537520 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Device paths {'sdg'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:48:59.537748 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:48:59.548086 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:59.575535 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 216, target: iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6, portal: 192.168.40.100,3260] Jul 05 03:48:59.575535 np0000004562 cinder-backup[101413]: Logout of [sid: 216, target: iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6, portal: 192.168.40.100,3260] successful. Jul 05 03:48:59.575535 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:59.588273 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:59.588603 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.168s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:48:59.588790 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] <== disconnect_volume: return (2940ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:48:59.590013 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.353s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:48:59.590281 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5113927-f7d6-4561-bd3f-c758db6d8325', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:48:59.601449 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:48:59.601908 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:48:59.602146 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:48:59.612465 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:48:59.612465 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:59.623322 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325] added Jul 05 03:48:59.623322 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:48:59.623322 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:48:59.623322 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:48:59.623322 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:48:59.623322 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:48:59.623322 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:48:59.623629 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:48:59.624054 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0217(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:48:59.624316 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:49:00.625762 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:49:00.630328 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:49:00.638910 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:00.646871 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-3672f883-faa4-4799-8053-1dcd20ce7b7a tempest-VolumesBackupsTest-1992217419 None] Create backup finished. backup: 524a0c46-9be5-4c6a-a359-d8fdb9ee8d34. Jul 05 03:49:00.649117 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:00.661593 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:49:00.661593 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:49:00.661593 np0000004562 cinder-backup[101413]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:00.661593 np0000004562 cinder-backup[101413]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:00.661593 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:49:00.661929 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:49:00.661929 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:49:00.661929 np0000004562 cinder-backup[101413]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:00.661929 np0000004562 cinder-backup[101413]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:00.661929 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:49:00.700157 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325, portal: 192.168.40.100,3260] Jul 05 03:49:00.700157 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325, portal: 192.168.40.100,3260] successful. Jul 05 03:49:00.700157 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:00.711314 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:00.724169 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:49:00.724169 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:49:00.724169 np0000004562 cinder-backup[101413]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:00.724169 np0000004562 cinder-backup[101413]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:00.724169 np0000004562 cinder-backup[101413]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:00.724169 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:49:00.724518 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:49:00.724518 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:49:00.724518 np0000004562 cinder-backup[101413]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:00.724518 np0000004562 cinder-backup[101413]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:00.724518 np0000004562 cinder-backup[101413]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:00.724518 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:49:00.724756 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.123s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:49:00.724756 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:49:00.725316 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] HCTL ('9', '-', '-', 0) found on session 219 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:49:00.725454 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Scanning host 9 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:49:00.737618 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Searching for a device in session 219 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:49:00.737618 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5113927-f7d6-4561-bd3f-c758db6d8325', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:49:01.301540 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Create backup started, backup: 5180e9e0-8723-4e39-bc7e-be7b8c0f245f volume: 7442e3cb-3175-47db-9861-9834880275b6. Jul 05 03:49:01.306387 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T03:49:01Z,data_timestamp=2026-07-05T03:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1684350521',encryption_key_id=None,fail_reason=None,host='np0000004562',id=5180e9e0-8723-4e39-bc7e-be7b8c0f245f,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(06cb9f42-018a-483f-8217-fe4a7c1b83ad),parent_id='06cb9f42-018a-483f-8217-fe4a7c1b83ad',project_id='d9a227fd10ab442fa1d322fa4e20c6ea',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='016ae708563743cd8cbb2b33ed9082cd',volume_id=7442e3cb-3175-47db-9861-9834880275b6) Jul 05 03:49:01.339168 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_d9a227fd10ab442fa1d322fa4e20c6ea {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:49:01.339639 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:49:01.339929 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:49:01.349648 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:49:01.368701 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:49:01.381207 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:49:01.381485 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:49:01.388865 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:49:01.389787 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fe3a:a676', 'fe80::e477:baff:fee9:cab5'] Jul 05 03:49:01.389902 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:49:01.390045 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:49:01.390293 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] <== get_connector_properties: return (50ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:49:01.739548 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.149s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:49:01.739926 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] <== connect_volume: return (4502ms) {'type': 'block', 'scsi_wwn': '33000000016d0b1f8', 'path': '/dev/sdd'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:49:01.740253 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:49:01.758285 np0000004562 sudo[154270]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd Jul 05 03:49:01.758918 np0000004562 sudo[154270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:49:01.894037 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:49:01.894512 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7442e3cb-3175-47db-9861-9834880275b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:49:01.894684 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:49:01.895154 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:49:01.895384 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7442e3cb-3175-47db-9861-9834880275b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:49:01.906894 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:49:01.907184 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:49:01.907378 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:49:01.916959 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:49:01.916959 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:01.926693 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6] added Jul 05 03:49:01.926693 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:49:01.926693 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:49:01.926693 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:49:01.926693 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:49:01.926693 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:49:01.926693 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:01.926919 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:49:01.927229 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0198(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:49:01.927415 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:49:02.037310 np0000004562 sudo[154270]: pam_unix(sudo:session): session closed for user root Jul 05 03:49:02.038965 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd" returned: 0 in 0.299s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:49:02.074828 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:49:02.080011 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] _create_container started, container: volumebackups,backup: 43a13ec7-8bb2-4118-96f0-671b8f175e1f. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:49:02.103364 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] generate_object_name_prefix: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:49:02.107761 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] starting backup of volume: b5113927-f7d6-4561-bd3f-c758db6d8325, volume size: 1073741824, object names prefix volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:49:02.296329 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:02.928674 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:49:02.941059 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:02.964246 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:02.964675 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 19825286 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:02.964829 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:03.003824 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:49:03.003824 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:49:03.003824 np0000004562 cinder-backup[101413]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:03.003824 np0000004562 cinder-backup[101413]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:03.003824 np0000004562 cinder-backup[101413]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:03.003824 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:49:03.004199 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:49:03.004199 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:49:03.004199 np0000004562 cinder-backup[101413]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:03.004199 np0000004562 cinder-backup[101413]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:03.004199 np0000004562 cinder-backup[101413]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:03.004199 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:49:03.044039 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6, portal: 192.168.40.100,3260] Jul 05 03:49:03.044039 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6, portal: 192.168.40.100,3260] successful. Jul 05 03:49:03.044039 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:03.055900 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:03.072127 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:49:03.072127 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:49:03.072127 np0000004562 cinder-backup[101413]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:03.072127 np0000004562 cinder-backup[101413]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:03.072127 np0000004562 cinder-backup[101413]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:03.072127 np0000004562 cinder-backup[101413]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 (non-flash) Jul 05 03:49:03.072127 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:49:03.072399 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:49:03.072399 np0000004562 cinder-backup[101413]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-98327501-f573-4bf8-b9d1-3ace07822dea (non-flash) Jul 05 03:49:03.072399 np0000004562 cinder-backup[101413]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:03.072399 np0000004562 cinder-backup[101413]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:03.072399 np0000004562 cinder-backup[101413]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:03.072399 np0000004562 cinder-backup[101413]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 (non-flash) Jul 05 03:49:03.072399 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:49:03.072576 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:49:03.072759 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:49:03.073493 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] HCTL ('12', '-', '-', 0) found on session 220 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:49:03.073640 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Scanning host 12 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:49:03.084759 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Searching for a device in session 220 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:49:03.084759 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7442e3cb-3175-47db-9861-9834880275b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:49:03.207976 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00001: 82571f7121cb9475563edde615e4e4df {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:03.208129 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:03.384079 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:03.625744 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:03.625903 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:03.722748 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:03.722910 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:03.902106 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:04.088471 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.193s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:49:04.088939 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] <== connect_volume: return (2193ms) {'type': 'block', 'scsi_wwn': '3300000004c04be8f', 'path': '/dev/sdg'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:49:04.089176 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdg {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:49:04.111816 np0000004562 sudo[154366]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdg Jul 05 03:49:04.112422 np0000004562 sudo[154366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:49:04.186249 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 1362154 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:04.186413 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:04.304537 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00003: a35891500449df17e893f84bd88472fb {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:04.304725 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:04.434024 np0000004562 sudo[154366]: pam_unix(sudo:session): session closed for user root Jul 05 03:49:04.436001 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdg" returned: 0 in 0.347s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:49:04.448569 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] _read_sha256file started, container name: volumebackups, sha256 filename: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad_sha256file. {{(pid=101413) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:333}} Jul 05 03:49:04.507940 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] _read_sha256file finished. {{(pid=101413) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:340}} Jul 05 03:49:04.514585 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] _create_container started, container: volumebackups,backup: 5180e9e0-8723-4e39-bc7e-be7b8c0f245f. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:49:04.516592 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:04.543650 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] generate_object_name_prefix: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034904/az_nova_backup_5180e9e0-8723-4e39-bc7e-be7b8c0f245f {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:49:04.547952 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] starting backup of volume: 7442e3cb-3175-47db-9861-9834880275b6, volume size: 1073741824, object names prefix volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034904/az_nova_backup_5180e9e0-8723-4e39-bc7e-be7b8c0f245f, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:49:04.803884 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:04.803884 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:04.902030 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:04.902222 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:05.178637 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:05.442870 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:05.443264 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:05.564212 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:05.564498 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:05.827909 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:06.083205 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:06.083367 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:06.187175 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:06.187699 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:06.455777 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:06.721626 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:06.721848 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:06.822500 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:06.822724 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:07.070293 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:07.332802 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:07.333280 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:07.433612 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:07.433946 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:07.764775 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:08.008420 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:08.008586 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:08.116337 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:08.116521 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:08.416529 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:08.669764 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:08.669824 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:08.777637 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:08.778369 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:08.925256 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:49:08.949924 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:49:08.950125 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:49:08.954269 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:49:08.954463 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:49:08.957251 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:49:08.957534 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034904/az_nova_backup_5180e9e0-8723-4e39-bc7e-be7b8c0f245f_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:49:09.010219 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:49:09.010831 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] _write_metadata started, container name: volumebackups, metadata filename: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034904/az_nova_backup_5180e9e0-8723-4e39-bc7e-be7b8c0f245f_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:49:09.014051 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:09.029825 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "5180e9e0-8723-4e39-bc7e-be7b8c0f245f",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1684350521",\n "created_at": "2026-07-05 03:49:01+00:00",\n "objects": [],\n "parent_id": "06cb9f42-018a-483f-8217-fe4a7c1b83ad",\n "version": "1.0.0",\n "volume_id": "7442e3cb-3175-47db-9861-9834880275b6",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"7442e3cb-3175-47db-9861-9834880275b6\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"b164eb7acb8f4f6caa1ce5a85a398ac0\\", \\"project_id\\": \\"57a311cbff5648e6a0168be82134cf61\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:48:20.000000\\", \\"launched_at\\": \\"2026-07-05T03:48:20.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-709573013\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:48:20.000000\\", \\"updated_at\\": \\"2026-07-05T03:49:01.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:49:09.034637 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] backup 5180e9e0-8723-4e39-bc7e-be7b8c0f245f finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:49:09.155436 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdg {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:49:09.176512 np0000004562 sudo[154452]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdg Jul 05 03:49:09.177179 np0000004562 sudo[154452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:49:09.267132 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:09.267362 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:09.373447 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:09.373609 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:09.552576 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:09.583061 np0000004562 sudo[154452]: pam_unix(sudo:session): session closed for user root Jul 05 03:49:09.584887 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdg" returned: 0 in 0.429s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:49:09.585504 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7442e3cb-3175-47db-9861-9834880275b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '3300000004c04be8f', 'path': '/dev/sdg'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:49:09.585732 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:49:09.586245 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:49:09.586674 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7442e3cb-3175-47db-9861-9834880275b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:49:09.596203 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:49:09.596203 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:49:09.596203 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:49:09.596203 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:49:09.596203 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:49:09.596203 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 Jul 05 03:49:09.596203 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:49:09.596203 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:49:09.596203 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 Jul 05 03:49:09.596203 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:49:09.596203 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:49:09.596203 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:49:09.596203 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:49:09.596203 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:49:09.596641 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:49:09.596641 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:49:09.596641 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:49:09.596641 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:49:09.618010 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] iscsiadm ('-m', 'session'): stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:09.618010 np0000004562 cinder-backup[101413]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 (non-flash) Jul 05 03:49:09.618010 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:49:09.618187 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] iscsi session list stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:09.618187 np0000004562 cinder-backup[101413]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 (non-flash) Jul 05 03:49:09.618187 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:49:09.618277 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325', '219'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', '220')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:49:09.618430 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', '220')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:49:09.619198 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Resulting device map defaultdict(. at 0x72a47001d4e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6'): ({'sdg'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:49:09.619413 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Removing single pathed devices sdg {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:49:09.629424 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Flushing IO for device /dev/sdg {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:49:09.636991 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:49:09.668117 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Checking to see if SCSI volumes sdg have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:49:09.668300 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] SCSI volumes sdg have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:49:09.669187 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Checking to see if device paths {'sdg'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:49:09.678845 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Device paths {'sdg'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:49:09.678994 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:49:09.688068 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:09.722836 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 220, target: iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6, portal: 192.168.40.100,3260] Jul 05 03:49:09.722836 np0000004562 cinder-backup[101413]: Logout of [sid: 220, target: iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6, portal: 192.168.40.100,3260] successful. Jul 05 03:49:09.722836 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:09.735219 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:09.735322 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.149s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:49:09.735477 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] <== disconnect_volume: return (149ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:49:09.794550 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:09.794599 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:09.896735 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:09.896873 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:10.073377 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:10.315606 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:10.315606 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:10.413983 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:10.414133 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:10.592206 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:10.758094 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-59571d97-9700-4026-9b28-c5cff04f7976 tempest-VolumesBackupsTest-1073117318 None] Create backup finished. backup: 5180e9e0-8723-4e39-bc7e-be7b8c0f245f. Jul 05 03:49:10.832893 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:10.833098 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:10.930088 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:10.930243 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:11.110893 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:11.354227 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:11.354391 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:11.452505 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:11.452696 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:11.647111 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Create backup started, backup: f19be8a2-57a6-44bf-b864-f8f698e1cd12 volume: 7442e3cb-3175-47db-9861-9834880275b6. Jul 05 03:49:11.651571 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T03:49:11Z,data_timestamp=2026-07-05T03:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1650883734',encryption_key_id=None,fail_reason=None,host='np0000004562',id=f19be8a2-57a6-44bf-b864-f8f698e1cd12,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(524a0c46-9be5-4c6a-a359-d8fdb9ee8d34),parent_id='524a0c46-9be5-4c6a-a359-d8fdb9ee8d34',project_id='57a311cbff5648e6a0168be82134cf61',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='b164eb7acb8f4f6caa1ce5a85a398ac0',volume_id=7442e3cb-3175-47db-9861-9834880275b6) Jul 05 03:49:11.657609 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:11.678211 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_57a311cbff5648e6a0168be82134cf61 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:49:11.678860 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:49:11.679159 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:49:11.690758 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:49:11.708422 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:49:11.724011 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:49:11.724357 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:49:11.731687 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:49:11.732536 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544'] Jul 05 03:49:11.732702 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:49:11.732854 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:49:11.733110 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] <== get_connector_properties: return (53ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:49:11.789995 np0000004562 cinder-backup[101413]: DEBUG oslo_service.periodic_task [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:49:11.790174 np0000004562 cinder-backup[101413]: DEBUG cinder.manager [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Notifying Schedulers of capabilities ... {{(pid=101413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:49:11.905489 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:11.905729 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:12.006364 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:12.006528 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:12.042566 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:49:12.236648 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:49:12.237191 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7442e3cb-3175-47db-9861-9834880275b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:49:12.237435 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:49:12.238002 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:49:12.238274 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7442e3cb-3175-47db-9861-9834880275b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:49:12.248574 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:49:12.249016 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:49:12.249226 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:49:12.255741 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:12.259347 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:49:12.259347 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:12.269224 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6] added Jul 05 03:49:12.269224 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:49:12.269224 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:49:12.269224 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:49:12.269224 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:49:12.269224 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:49:12.269224 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:12.269435 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:49:12.269766 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0205(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:49:12.269943 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:49:12.505641 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:12.505781 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:12.600747 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:12.600973 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:12.768896 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:13.013849 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:13.013999 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:13.110672 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:13.110858 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:13.270850 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:49:13.281753 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:13.284658 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:13.292942 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:13.303099 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] iscsiadm ('-m', 'session'): stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:13.303099 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:49:13.303253 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] iscsi session list stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:13.303253 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:49:13.325847 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6, portal: 192.168.40.100,3260] Jul 05 03:49:13.325847 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6, portal: 192.168.40.100,3260] successful. Jul 05 03:49:13.325847 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:13.338319 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:13.351200 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] iscsiadm ('-m', 'session'): stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:13.351200 np0000004562 cinder-backup[101413]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 (non-flash) Jul 05 03:49:13.351200 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:49:13.351411 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] iscsi session list stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:13.351411 np0000004562 cinder-backup[101413]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 (non-flash) Jul 05 03:49:13.351411 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:49:13.351646 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.103s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:49:13.351799 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:49:13.352270 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] HCTL ('7', '-', '-', 0) found on session 221 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:49:13.352412 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:49:13.364001 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Searching for a device in session 221 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:49:13.364195 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7442e3cb-3175-47db-9861-9834880275b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:49:13.533511 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:13.533643 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:13.630929 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:13.631137 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:13.811052 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:14.056947 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:14.057081 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:14.152383 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:14.152578 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:14.245154 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:14.359532 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:14.359672 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:14.366747 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.129s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:49:14.366940 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] <== connect_volume: return (2129ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799238', 'path': '/dev/sdb'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:49:14.367236 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:49:14.386786 np0000004562 sudo[154552]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 05 03:49:14.387408 np0000004562 sudo[154552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:49:14.421346 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:14.421479 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:14.430253 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:49:14.436811 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:49:14.436939 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:49:14.440404 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:49:14.440556 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:49:14.443515 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Completed fetching metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:145}} Jul 05 03:49:14.443807 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:49:14.497375 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:49:14.498255 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] _write_metadata started, container name: volumebackups, metadata filename: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:49:14.523270 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "43a13ec7-8bb2-4118-96f0-671b8f175e1f",\n "backup_name": "tempest-VolumesBackupsTest-Backup-110875073",\n "created_at": "2026-07-05 03:48:57+00:00",\n "objects": [\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "82571f7121cb9475563edde615e4e4df",\n "offset": 0\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "a35891500449df17e893f84bd88472fb",\n "offset": 104857600\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "b5113927-f7d6-4561-bd3f-c758db6d8325",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"b5113927-f7d6-4561-bd3f-c758db6d8325\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"ea1163b57d574d8c9031fe9c82c96b2c\\", \\"project_id\\": \\"2ee62c33d51844a9a90e9a9e640d703b\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:48:56.000000\\", \\"launched_at\\": \\"2026-07-05T03:48:56.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-697546179\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": true, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:48:55.000000\\", \\"updated_at\\": \\"2026-07-05T03:48:57.000000\\"}, \\"volume-glance-metadata\\": {\\"hw_rng_model\\": \\"virtio\\", \\"os_glance_failed_import\\": \\"\\", \\"os_glance_importing_to_stores\\": \\"\\", \\"owner_specified.openstack.md5\\": \\"\\", \\"owner_specified.openstack.object\\": \\"images/cirros-0.6.3-x86_64-disk\\", \\"owner_specified.openstack.sha256\\": \\"\\", \\"image_id\\": \\"0c8fa207-3de5-4489-a2c5-f4cc8559edb8\\", \\"image_name\\": \\"cirros-0.6.3-x86_64-disk\\", \\"checksum\\": \\"87617e24a5e30cb3b87fda8c0764838f\\", \\"container_format\\": \\"bare\\", \\"disk_format\\": \\"qcow2\\", \\"min_disk\\": \\"0\\", \\"min_ram\\": \\"0\\", \\"size\\": \\"21692416\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:49:14.528385 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] backup 43a13ec7-8bb2-4118-96f0-671b8f175e1f finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:49:14.660522 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:49:14.678115 np0000004562 sudo[154555]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd Jul 05 03:49:14.678774 np0000004562 sudo[154555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:49:14.688009 np0000004562 sudo[154552]: pam_unix(sudo:session): session closed for user root Jul 05 03:49:14.690160 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.322s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:49:14.696427 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] _read_sha256file started, container name: volumebackups, sha256 filename: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34_sha256file. {{(pid=101413) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:333}} Jul 05 03:49:14.726887 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] _read_sha256file finished. {{(pid=101413) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:340}} Jul 05 03:49:14.732586 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] _create_container started, container: volumebackups,backup: f19be8a2-57a6-44bf-b864-f8f698e1cd12. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:49:14.758371 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] generate_object_name_prefix: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034914/az_nova_backup_f19be8a2-57a6-44bf-b864-f8f698e1cd12 {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:49:14.764866 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] starting backup of volume: 7442e3cb-3175-47db-9861-9834880275b6, volume size: 1073741824, object names prefix volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034914/az_nova_backup_f19be8a2-57a6-44bf-b864-f8f698e1cd12, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:49:15.010085 np0000004562 sudo[154555]: pam_unix(sudo:session): session closed for user root Jul 05 03:49:15.011913 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd" returned: 0 in 0.352s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:49:15.012464 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5113927-f7d6-4561-bd3f-c758db6d8325', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '33000000016d0b1f8', 'path': '/dev/sdd'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:49:15.012647 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:49:15.013173 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:49:15.013635 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5113927-f7d6-4561-bd3f-c758db6d8325', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:49:15.026088 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:49:15.026088 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:49:15.026088 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:49:15.026088 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:49:15.026088 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:49:15.026088 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 Jul 05 03:49:15.026088 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:49:15.026088 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:49:15.026088 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 Jul 05 03:49:15.026088 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:49:15.026088 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:49:15.026088 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:49:15.026088 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:49:15.026088 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:49:15.026561 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:49:15.026561 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:49:15.026561 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:49:15.026653 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:49:15.054436 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('-m', 'session'): stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:15.054436 np0000004562 cinder-backup[101413]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 (non-flash) Jul 05 03:49:15.054436 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:49:15.054562 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] iscsi session list stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:15.054562 np0000004562 cinder-backup[101413]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 (non-flash) Jul 05 03:49:15.054562 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:49:15.054663 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325', '219'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', '221')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:49:15.054840 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325', '219')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:49:15.055728 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Resulting device map defaultdict(. at 0x72a470547c40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325'): ({'sdd'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:49:15.055939 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Removing single pathed devices sdd {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:49:15.068043 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Flushing IO for device /dev/sdd {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:49:15.076613 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:49:15.142013 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Checking to see if SCSI volumes sdd have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:49:15.142272 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] SCSI volumes sdd have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:49:15.143837 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Checking to see if device paths {'sdd'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:49:15.155249 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Device paths {'sdd'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:49:15.155647 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:49:15.167549 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:15.205422 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 219, target: iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325, portal: 192.168.40.100,3260] Jul 05 03:49:15.205422 np0000004562 cinder-backup[101413]: Logout of [sid: 219, target: iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325, portal: 192.168.40.100,3260] successful. Jul 05 03:49:15.205422 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:15.217082 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:15.217388 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.204s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:49:15.217531 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] <== disconnect_volume: return (204ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:49:16.232695 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-327e6caa-67b9-426b-94fa-41a0c51e68fb tempest-VolumesBackupsTest-1375540242 None] Create backup finished. backup: 43a13ec7-8bb2-4118-96f0-671b8f175e1f. Jul 05 03:49:18.384099 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:49:18.389802 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:49:18.389996 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:49:18.394070 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:49:18.394263 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:49:18.397305 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:49:18.397564 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034914/az_nova_backup_f19be8a2-57a6-44bf-b864-f8f698e1cd12_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:49:18.454929 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:49:18.455661 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] _write_metadata started, container name: volumebackups, metadata filename: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034914/az_nova_backup_f19be8a2-57a6-44bf-b864-f8f698e1cd12_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:49:18.483539 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "f19be8a2-57a6-44bf-b864-f8f698e1cd12",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1650883734",\n "created_at": "2026-07-05 03:49:12+00:00",\n "objects": [],\n "parent_id": "524a0c46-9be5-4c6a-a359-d8fdb9ee8d34",\n "version": "1.0.0",\n "volume_id": "7442e3cb-3175-47db-9861-9834880275b6",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"7442e3cb-3175-47db-9861-9834880275b6\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"b164eb7acb8f4f6caa1ce5a85a398ac0\\", \\"project_id\\": \\"57a311cbff5648e6a0168be82134cf61\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:48:20.000000\\", \\"launched_at\\": \\"2026-07-05T03:48:20.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-709573013\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:48:20.000000\\", \\"updated_at\\": \\"2026-07-05T03:49:12.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:49:18.489629 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] backup f19be8a2-57a6-44bf-b864-f8f698e1cd12 finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:49:18.625961 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:49:18.645612 np0000004562 sudo[154605]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 05 03:49:18.646305 np0000004562 sudo[154605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:49:18.966841 np0000004562 sudo[154605]: pam_unix(sudo:session): session closed for user root Jul 05 03:49:18.968760 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.343s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:49:18.969415 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7442e3cb-3175-47db-9861-9834880275b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799238', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:49:18.969596 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:49:21.328941 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.359s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:49:21.329581 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7442e3cb-3175-47db-9861-9834880275b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:49:21.340538 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:49:21.340538 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:49:21.340538 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:49:21.340538 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:49:21.340538 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:49:21.340538 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 Jul 05 03:49:21.340538 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:49:21.340538 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:49:21.340538 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:49:21.340538 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:49:21.340538 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 Jul 05 03:49:21.340538 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:49:21.340538 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:49:21.340538 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:49:21.340538 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:49:21.340538 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:49:21.340963 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:49:21.340963 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:49:21.340963 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:49:21.341039 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:49:21.363122 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 (non-flash) Jul 05 03:49:21.363122 np0000004562 cinder-backup[101413]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:21.363122 np0000004562 cinder-backup[101413]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:21.363122 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:49:21.363296 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] iscsi session list stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6 (non-flash) Jul 05 03:49:21.363296 np0000004562 cinder-backup[101413]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:21.363296 np0000004562 cinder-backup[101413]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:21.363296 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:49:21.363475 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', '221'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9', '222'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9', '223')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:49:21.363669 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6', '221')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:49:21.364729 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Resulting device map defaultdict(. at 0x72a48e94d300>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6'): ({'sdb'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:49:21.364999 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Removing single pathed devices sdb {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:49:21.375224 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Flushing IO for device /dev/sdb {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:49:21.384754 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:49:21.443178 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:49:21.443343 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:49:21.444182 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:49:21.455543 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:49:21.455795 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:49:21.465514 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:21.495924 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 221, target: iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6, portal: 192.168.40.100,3260] Jul 05 03:49:21.495924 np0000004562 cinder-backup[101413]: Logout of [sid: 221, target: iqn.2023-03.storpool.com:os--volume-7442e3cb-3175-47db-9861-9834880275b6, portal: 192.168.40.100,3260] successful. Jul 05 03:49:21.495924 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:21.509212 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:21.509470 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.181s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:49:21.509630 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] <== disconnect_volume: return (2539ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:49:22.535970 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-93afa83a-6145-43a1-8620-b2228ddc29a7 tempest-VolumesBackupsTest-1992217419 None] Create backup finished. backup: f19be8a2-57a6-44bf-b864-f8f698e1cd12. Jul 05 03:49:22.893464 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-fe5522cc-8b02-494e-be8a-b0d465bb244d tempest-VolumesBackupsTest-1992217419 None] Delete backup started, backup: f19be8a2-57a6-44bf-b864-f8f698e1cd12. Jul 05 03:49:22.899893 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-fe5522cc-8b02-494e-be8a-b0d465bb244d tempest-VolumesBackupsTest-1992217419 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_57a311cbff5648e6a0168be82134cf61 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:49:22.900108 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-fe5522cc-8b02-494e-be8a-b0d465bb244d tempest-VolumesBackupsTest-1992217419 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:49:22.900288 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-fe5522cc-8b02-494e-be8a-b0d465bb244d tempest-VolumesBackupsTest-1992217419 None] delete started, backup: f19be8a2-57a6-44bf-b864-f8f698e1cd12, container: volumebackups, prefix: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034914/az_nova_backup_f19be8a2-57a6-44bf-b864-f8f698e1cd12. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:49:22.934177 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-fe5522cc-8b02-494e-be8a-b0d465bb244d tempest-VolumesBackupsTest-1992217419 None] generated object list: ['volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034914/az_nova_backup_f19be8a2-57a6-44bf-b864-f8f698e1cd12_metadata', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034914/az_nova_backup_f19be8a2-57a6-44bf-b864-f8f698e1cd12_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:49:22.954837 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-fe5522cc-8b02-494e-be8a-b0d465bb244d tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034914/az_nova_backup_f19be8a2-57a6-44bf-b864-f8f698e1cd12_metadata in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:22.973044 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-fe5522cc-8b02-494e-be8a-b0d465bb244d tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034914/az_nova_backup_f19be8a2-57a6-44bf-b864-f8f698e1cd12_sha256file in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:22.973343 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-fe5522cc-8b02-494e-be8a-b0d465bb244d tempest-VolumesBackupsTest-1992217419 None] delete f19be8a2-57a6-44bf-b864-f8f698e1cd12 finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:49:23.008556 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-fe5522cc-8b02-494e-be8a-b0d465bb244d tempest-VolumesBackupsTest-1992217419 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:49:23.024287 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-fe5522cc-8b02-494e-be8a-b0d465bb244d tempest-VolumesBackupsTest-1992217419 None] Created reservations ['c301f4a2-5f07-4d20-8ff0-52c7e9ef0e92', 'a9cc8fef-b89a-4f6a-8771-81adfcc64b80'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:49:23.047451 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-fe5522cc-8b02-494e-be8a-b0d465bb244d tempest-VolumesBackupsTest-1992217419 None] Delete backup finished, backup f19be8a2-57a6-44bf-b864-f8f698e1cd12 deleted. Jul 05 03:49:23.948805 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-e62cd6af-7251-4bd2-8144-ad63d922ffc2 tempest-VolumesBackupsTest-1073117318 None] Delete backup started, backup: 5180e9e0-8723-4e39-bc7e-be7b8c0f245f. Jul 05 03:49:23.951769 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-e62cd6af-7251-4bd2-8144-ad63d922ffc2 tempest-VolumesBackupsTest-1073117318 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_d9a227fd10ab442fa1d322fa4e20c6ea {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:49:23.952222 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-e62cd6af-7251-4bd2-8144-ad63d922ffc2 tempest-VolumesBackupsTest-1073117318 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:49:23.952402 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e62cd6af-7251-4bd2-8144-ad63d922ffc2 tempest-VolumesBackupsTest-1073117318 None] delete started, backup: 5180e9e0-8723-4e39-bc7e-be7b8c0f245f, container: volumebackups, prefix: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034904/az_nova_backup_5180e9e0-8723-4e39-bc7e-be7b8c0f245f. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:49:23.986193 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e62cd6af-7251-4bd2-8144-ad63d922ffc2 tempest-VolumesBackupsTest-1073117318 None] generated object list: ['volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034904/az_nova_backup_5180e9e0-8723-4e39-bc7e-be7b8c0f245f_metadata', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034904/az_nova_backup_5180e9e0-8723-4e39-bc7e-be7b8c0f245f_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:49:24.001679 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e62cd6af-7251-4bd2-8144-ad63d922ffc2 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034904/az_nova_backup_5180e9e0-8723-4e39-bc7e-be7b8c0f245f_metadata in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:24.017651 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e62cd6af-7251-4bd2-8144-ad63d922ffc2 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034904/az_nova_backup_5180e9e0-8723-4e39-bc7e-be7b8c0f245f_sha256file in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:24.017840 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-e62cd6af-7251-4bd2-8144-ad63d922ffc2 tempest-VolumesBackupsTest-1073117318 None] delete 5180e9e0-8723-4e39-bc7e-be7b8c0f245f finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:49:24.047223 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-e62cd6af-7251-4bd2-8144-ad63d922ffc2 tempest-VolumesBackupsTest-1073117318 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:49:24.058315 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-e62cd6af-7251-4bd2-8144-ad63d922ffc2 tempest-VolumesBackupsTest-1073117318 None] Created reservations ['5bcd07f2-1196-487d-b69a-435f5b71344d', 'e0c3ee09-c4d1-44da-a8f2-d4ccf3f2fee2'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:49:24.075030 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-e62cd6af-7251-4bd2-8144-ad63d922ffc2 tempest-VolumesBackupsTest-1073117318 None] Delete backup finished, backup 5180e9e0-8723-4e39-bc7e-be7b8c0f245f deleted. Jul 05 03:49:25.004669 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-da2f61fc-fa6d-473c-acb5-7749e43ecffb tempest-VolumesBackupsTest-1992217419 None] Delete backup started, backup: 524a0c46-9be5-4c6a-a359-d8fdb9ee8d34. Jul 05 03:49:25.007844 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-da2f61fc-fa6d-473c-acb5-7749e43ecffb tempest-VolumesBackupsTest-1992217419 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_57a311cbff5648e6a0168be82134cf61 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:49:25.008023 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-da2f61fc-fa6d-473c-acb5-7749e43ecffb tempest-VolumesBackupsTest-1992217419 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:49:25.008186 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-da2f61fc-fa6d-473c-acb5-7749e43ecffb tempest-VolumesBackupsTest-1992217419 None] delete started, backup: 524a0c46-9be5-4c6a-a359-d8fdb9ee8d34, container: volumebackups, prefix: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:49:25.042211 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-da2f61fc-fa6d-473c-acb5-7749e43ecffb tempest-VolumesBackupsTest-1992217419 None] generated object list: ['volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00001', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00002', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00003', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00004', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00005', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00006', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00007', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00008', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00009', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00010', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00011', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00012', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00013', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00014', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00015', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00016', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00017', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00018', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00019', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00020', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00021', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34_metadata', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:49:25.058689 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-da2f61fc-fa6d-473c-acb5-7749e43ecffb tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00001 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:25.075147 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-da2f61fc-fa6d-473c-acb5-7749e43ecffb tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00002 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:25.092240 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-da2f61fc-fa6d-473c-acb5-7749e43ecffb tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00003 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:25.109200 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-da2f61fc-fa6d-473c-acb5-7749e43ecffb tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00004 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:25.126177 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-da2f61fc-fa6d-473c-acb5-7749e43ecffb tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00005 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:25.143309 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-da2f61fc-fa6d-473c-acb5-7749e43ecffb tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00006 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:25.160146 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-da2f61fc-fa6d-473c-acb5-7749e43ecffb tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00007 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:25.179763 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-da2f61fc-fa6d-473c-acb5-7749e43ecffb tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00008 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:25.197386 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-da2f61fc-fa6d-473c-acb5-7749e43ecffb tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00009 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:25.215722 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-da2f61fc-fa6d-473c-acb5-7749e43ecffb tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00010 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:25.233105 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-da2f61fc-fa6d-473c-acb5-7749e43ecffb tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00011 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:25.253433 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-da2f61fc-fa6d-473c-acb5-7749e43ecffb tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00012 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:25.272826 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-da2f61fc-fa6d-473c-acb5-7749e43ecffb tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00013 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:25.290258 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-da2f61fc-fa6d-473c-acb5-7749e43ecffb tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00014 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:25.307447 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-da2f61fc-fa6d-473c-acb5-7749e43ecffb tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00015 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:25.337481 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-da2f61fc-fa6d-473c-acb5-7749e43ecffb tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00016 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:25.364578 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-da2f61fc-fa6d-473c-acb5-7749e43ecffb tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00017 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:25.387323 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-da2f61fc-fa6d-473c-acb5-7749e43ecffb tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00018 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:25.406129 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-da2f61fc-fa6d-473c-acb5-7749e43ecffb tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00019 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:25.428404 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-da2f61fc-fa6d-473c-acb5-7749e43ecffb tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00020 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:25.452174 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-da2f61fc-fa6d-473c-acb5-7749e43ecffb tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34-00021 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:25.469144 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-da2f61fc-fa6d-473c-acb5-7749e43ecffb tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34_metadata in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:25.486463 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-da2f61fc-fa6d-473c-acb5-7749e43ecffb tempest-VolumesBackupsTest-1992217419 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034843/az_nova_backup_524a0c46-9be5-4c6a-a359-d8fdb9ee8d34_sha256file in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:25.486463 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-da2f61fc-fa6d-473c-acb5-7749e43ecffb tempest-VolumesBackupsTest-1992217419 None] delete 524a0c46-9be5-4c6a-a359-d8fdb9ee8d34 finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:49:25.521357 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-da2f61fc-fa6d-473c-acb5-7749e43ecffb tempest-VolumesBackupsTest-1992217419 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:49:25.534081 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-da2f61fc-fa6d-473c-acb5-7749e43ecffb tempest-VolumesBackupsTest-1992217419 None] Created reservations ['6a47faf9-bd3b-4cfd-9288-d1086a24eb5c', '4f5cacb0-8235-43d0-8bf0-d316a0327842'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:49:25.552632 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-da2f61fc-fa6d-473c-acb5-7749e43ecffb tempest-VolumesBackupsTest-1992217419 None] Delete backup finished, backup 524a0c46-9be5-4c6a-a359-d8fdb9ee8d34 deleted. Jul 05 03:49:26.059472 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-bc50555a-3f06-4b79-ae7e-7a45bff5d118 tempest-VolumesBackupsTest-1073117318 None] Delete backup started, backup: 06cb9f42-018a-483f-8217-fe4a7c1b83ad. Jul 05 03:49:26.062077 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-bc50555a-3f06-4b79-ae7e-7a45bff5d118 tempest-VolumesBackupsTest-1073117318 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_d9a227fd10ab442fa1d322fa4e20c6ea {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:49:26.062207 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-bc50555a-3f06-4b79-ae7e-7a45bff5d118 tempest-VolumesBackupsTest-1073117318 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:49:26.062356 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc50555a-3f06-4b79-ae7e-7a45bff5d118 tempest-VolumesBackupsTest-1073117318 None] delete started, backup: 06cb9f42-018a-483f-8217-fe4a7c1b83ad, container: volumebackups, prefix: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:49:26.098405 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc50555a-3f06-4b79-ae7e-7a45bff5d118 tempest-VolumesBackupsTest-1073117318 None] generated object list: ['volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00001', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00002', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00003', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00004', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00005', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00006', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00007', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00008', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00009', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00010', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00011', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00012', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00013', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00014', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00015', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00016', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00017', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00018', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00019', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00020', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00021', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad_metadata', 'volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:49:26.116638 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc50555a-3f06-4b79-ae7e-7a45bff5d118 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00001 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:26.133233 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc50555a-3f06-4b79-ae7e-7a45bff5d118 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00002 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:26.151868 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc50555a-3f06-4b79-ae7e-7a45bff5d118 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00003 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:26.169785 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc50555a-3f06-4b79-ae7e-7a45bff5d118 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00004 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:26.189419 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc50555a-3f06-4b79-ae7e-7a45bff5d118 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00005 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:26.209043 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc50555a-3f06-4b79-ae7e-7a45bff5d118 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00006 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:26.227635 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc50555a-3f06-4b79-ae7e-7a45bff5d118 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00007 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:26.247813 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc50555a-3f06-4b79-ae7e-7a45bff5d118 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00008 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:26.266193 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc50555a-3f06-4b79-ae7e-7a45bff5d118 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00009 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:26.284173 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc50555a-3f06-4b79-ae7e-7a45bff5d118 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00010 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:26.302266 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc50555a-3f06-4b79-ae7e-7a45bff5d118 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00011 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:26.318919 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc50555a-3f06-4b79-ae7e-7a45bff5d118 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00012 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:26.335760 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc50555a-3f06-4b79-ae7e-7a45bff5d118 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00013 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:26.353344 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc50555a-3f06-4b79-ae7e-7a45bff5d118 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00014 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:26.371878 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc50555a-3f06-4b79-ae7e-7a45bff5d118 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00015 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:26.390303 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc50555a-3f06-4b79-ae7e-7a45bff5d118 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00016 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:26.408305 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc50555a-3f06-4b79-ae7e-7a45bff5d118 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00017 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:26.426760 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc50555a-3f06-4b79-ae7e-7a45bff5d118 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00018 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:26.447198 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc50555a-3f06-4b79-ae7e-7a45bff5d118 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00019 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:26.466334 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc50555a-3f06-4b79-ae7e-7a45bff5d118 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00020 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:26.484472 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc50555a-3f06-4b79-ae7e-7a45bff5d118 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad-00021 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:26.502820 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc50555a-3f06-4b79-ae7e-7a45bff5d118 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad_metadata in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:26.520748 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc50555a-3f06-4b79-ae7e-7a45bff5d118 tempest-VolumesBackupsTest-1073117318 None] deleted object: volume_7442e3cb-3175-47db-9861-9834880275b6/20260705034824/az_nova_backup_06cb9f42-018a-483f-8217-fe4a7c1b83ad_sha256file in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:49:26.520748 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc50555a-3f06-4b79-ae7e-7a45bff5d118 tempest-VolumesBackupsTest-1073117318 None] delete 06cb9f42-018a-483f-8217-fe4a7c1b83ad finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:49:26.558365 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-bc50555a-3f06-4b79-ae7e-7a45bff5d118 tempest-VolumesBackupsTest-1073117318 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:49:26.571101 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-bc50555a-3f06-4b79-ae7e-7a45bff5d118 tempest-VolumesBackupsTest-1073117318 None] Created reservations ['bf3fa3a5-5e05-479f-94f9-d31caebddf85', 'cec46b04-9143-4eee-9419-a13abc3ba2dc'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:49:26.583503 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-bc50555a-3f06-4b79-ae7e-7a45bff5d118 tempest-VolumesBackupsTest-1073117318 None] Delete backup finished, backup 06cb9f42-018a-483f-8217-fe4a7c1b83ad deleted. Jul 05 03:49:33.874531 np0000004562 cinder-backup[101413]: DEBUG dbcounter [-] [101413] Writing DB stats cinder:SELECT=232,cinder:UPDATE=76,cinder:INSERT=12 {{(pid=101413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:49:33.879023 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Create backup started, backup: 0fb098e1-7ce9-4b97-ae94-e28560a3009d volume: 349583ee-2c02-4c07-a6a5-82a2b9ee11fb. Jul 05 03:49:33.883811 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T03:49:33Z,data_timestamp=2026-07-05T03:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-1522507942',encryption_key_id=None,fail_reason=None,host='np0000004562',id=0fb098e1-7ce9-4b97-ae94-e28560a3009d,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='d87c99eeab2f4b1da9cfddf03f0cb8b9',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='2ad4e04899004f869203dfc0cc31f944',volume_id=349583ee-2c02-4c07-a6a5-82a2b9ee11fb) Jul 05 03:49:33.911032 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_d87c99eeab2f4b1da9cfddf03f0cb8b9 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:49:33.911664 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:49:33.912097 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:49:33.923158 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:49:33.942973 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:49:33.957561 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:49:33.957907 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:49:33.965676 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:49:33.966835 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fec8:e38e', 'fe80::d8a1:37ff:feaa:ab63', 'fe80::f816:3eff:fec3:297f', 'fe80::e477:baff:fee9:cab5', 'fe80::fcb0:ddff:fe37:cbb8'] Jul 05 03:49:33.967019 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:49:33.967202 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:49:33.967534 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] <== get_connector_properties: return (54ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:49:34.473453 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:49:34.473975 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-349583ee-2c02-4c07-a6a5-82a2b9ee11fb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '349583ee-2c02-4c07-a6a5-82a2b9ee11fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:49:34.474208 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:49:34.475230 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:49:34.475551 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-349583ee-2c02-4c07-a6a5-82a2b9ee11fb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '349583ee-2c02-4c07-a6a5-82a2b9ee11fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:49:34.485809 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-349583ee-2c02-4c07-a6a5-82a2b9ee11fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:49:34.486325 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-349583ee-2c02-4c07-a6a5-82a2b9ee11fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:49:34.486619 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:49:34.496655 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:49:34.496655 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:34.506968 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-349583ee-2c02-4c07-a6a5-82a2b9ee11fb] added Jul 05 03:49:34.506968 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:49:34.506968 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:49:34.506968 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:49:34.506968 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:49:34.506968 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:49:34.506968 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:34.507284 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:49:34.507651 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.021(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:49:34.507900 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:49:35.508849 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-349583ee-2c02-4c07-a6a5-82a2b9ee11fb Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:49:35.520404 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:35.530136 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:35.543385 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] iscsiadm ('-m', 'session'): stdout=tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:35.543385 np0000004562 cinder-backup[101413]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:35.543385 np0000004562 cinder-backup[101413]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:49:35.543385 np0000004562 cinder-backup[101413]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:49:35.543385 np0000004562 cinder-backup[101413]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:35.543385 np0000004562 cinder-backup[101413]: tcp: [227] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:35.543385 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:49:35.543660 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] iscsi session list stdout=tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:35.543660 np0000004562 cinder-backup[101413]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:35.543660 np0000004562 cinder-backup[101413]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:49:35.543660 np0000004562 cinder-backup[101413]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:49:35.543660 np0000004562 cinder-backup[101413]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:35.543660 np0000004562 cinder-backup[101413]: tcp: [227] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:35.543660 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:49:35.577523 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-349583ee-2c02-4c07-a6a5-82a2b9ee11fb, portal: 192.168.40.100,3260] Jul 05 03:49:35.577523 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-349583ee-2c02-4c07-a6a5-82a2b9ee11fb, portal: 192.168.40.100,3260] successful. Jul 05 03:49:35.577523 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:35.588351 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:35.601473 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] iscsiadm ('-m', 'session'): stdout=tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:35.601473 np0000004562 cinder-backup[101413]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:35.601473 np0000004562 cinder-backup[101413]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:49:35.601473 np0000004562 cinder-backup[101413]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:49:35.601473 np0000004562 cinder-backup[101413]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:35.601473 np0000004562 cinder-backup[101413]: tcp: [227] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:35.601473 np0000004562 cinder-backup[101413]: tcp: [228] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-349583ee-2c02-4c07-a6a5-82a2b9ee11fb (non-flash) Jul 05 03:49:35.601473 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:49:35.601850 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] iscsi session list stdout=tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:35.601850 np0000004562 cinder-backup[101413]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:35.601850 np0000004562 cinder-backup[101413]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:49:35.601850 np0000004562 cinder-backup[101413]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:49:35.601850 np0000004562 cinder-backup[101413]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:35.601850 np0000004562 cinder-backup[101413]: tcp: [227] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:35.601850 np0000004562 cinder-backup[101413]: tcp: [228] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-349583ee-2c02-4c07-a6a5-82a2b9ee11fb (non-flash) Jul 05 03:49:35.601850 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:49:35.602092 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-349583ee-2c02-4c07-a6a5-82a2b9ee11fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.116s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:49:35.602178 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:49:35.603108 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] HCTL ('13', '-', '-', 0) found on session 228 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:49:35.603295 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Scanning host 13 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:49:35.618335 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Searching for a device in session 228 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:49:35.618335 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-349583ee-2c02-4c07-a6a5-82a2b9ee11fb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '349583ee-2c02-4c07-a6a5-82a2b9ee11fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:49:36.618973 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.144s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:49:36.619439 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] <== connect_volume: return (2145ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799245', 'path': '/dev/sdh'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:49:36.619588 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:49:36.637520 np0000004562 sudo[155566]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh Jul 05 03:49:36.638295 np0000004562 sudo[155566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:49:36.943581 np0000004562 sudo[155566]: pam_unix(sudo:session): session closed for user root Jul 05 03:49:36.946001 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh" returned: 0 in 0.326s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:49:36.981819 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:49:36.987602 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] _create_container started, container: volumebackups,backup: 0fb098e1-7ce9-4b97-ae94-e28560a3009d. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:49:37.147166 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] generate_object_name_prefix: volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:49:37.152198 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] starting backup of volume: 349583ee-2c02-4c07-a6a5-82a2b9ee11fb, volume size: 1073741824, object names prefix volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:49:37.343728 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:37.590432 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:37.590817 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:37.700768 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:37.701336 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:37.905006 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:38.160765 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:38.160893 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:38.259893 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:38.260044 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:38.437974 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:38.683240 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:38.683469 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:38.784872 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:38.784872 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:38.983877 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:39.241626 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:39.241789 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:39.340495 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:39.340682 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:39.514757 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:39.761677 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:39.761842 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:39.856992 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:39.857539 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:40.036467 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:40.288144 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:40.288352 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:40.388637 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:40.388834 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:40.605415 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:40.869219 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:40.869736 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:40.966281 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:40.966440 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:41.164470 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:41.414909 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:41.415024 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:41.512243 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:41.512450 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:41.699581 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:41.945232 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:41.945834 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:42.045557 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:42.045703 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:42.212064 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:42.456339 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:42.456485 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:42.556643 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:42.556833 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:42.735088 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:42.977048 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:42.977532 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:43.073037 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:43.073202 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:43.279126 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:43.523406 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:43.523585 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:43.620906 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:43.621105 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:43.831796 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:44.077761 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:44.078069 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:44.176341 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:44.176561 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:44.348564 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:44.591301 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:44.591481 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:44.689535 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:44.689759 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:44.874290 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:45.121252 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:45.121668 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:45.222829 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:45.222968 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:45.407596 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:45.655355 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:45.655576 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:45.759437 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:45.759634 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:45.951942 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:46.202262 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:46.202798 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:46.305966 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:46.306226 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:46.491100 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:46.744244 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:46.744409 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:46.847430 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:46.847652 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:47.027331 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:47.275576 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:47.276026 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:47.375870 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:47.376029 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:47.538319 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:47.780944 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:47.781136 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:47.881476 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:47.881656 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:47.964632 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:48.085016 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:48.085236 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:48.145328 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:48.145534 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:48.159937 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:49:48.164815 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:49:48.164815 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:49:48.168200 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:49:48.168543 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:49:48.171620 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:49:48.172015 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:49:48.227686 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:49:48.227686 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] _write_metadata started, container name: volumebackups, metadata filename: volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:49:48.249073 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "0fb098e1-7ce9-4b97-ae94-e28560a3009d",\n "backup_name": "tempest-type-Backup-1522507942",\n "created_at": "2026-07-05 03:49:34+00:00",\n "objects": [\n {\n "volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "349583ee-2c02-4c07-a6a5-82a2b9ee11fb",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"349583ee-2c02-4c07-a6a5-82a2b9ee11fb\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"2ad4e04899004f869203dfc0cc31f944\\", \\"project_id\\": \\"d87c99eeab2f4b1da9cfddf03f0cb8b9\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:49:33.000000\\", \\"launched_at\\": \\"2026-07-05T03:49:33.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1746101757\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:49:33.000000\\", \\"updated_at\\": \\"2026-07-05T03:49:34.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:49:48.253090 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] backup 0fb098e1-7ce9-4b97-ae94-e28560a3009d finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:49:48.374312 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:49:48.393628 np0000004562 sudo[155638]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh Jul 05 03:49:48.394260 np0000004562 sudo[155638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:49:48.696800 np0000004562 sudo[155638]: pam_unix(sudo:session): session closed for user root Jul 05 03:49:48.700734 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh" returned: 0 in 0.324s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:49:48.700734 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-349583ee-2c02-4c07-a6a5-82a2b9ee11fb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '349583ee-2c02-4c07-a6a5-82a2b9ee11fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799245', 'path': '/dev/sdh'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:49:48.700734 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:49:48.700734 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:49:48.701013 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-349583ee-2c02-4c07-a6a5-82a2b9ee11fb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '349583ee-2c02-4c07-a6a5-82a2b9ee11fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:49:48.714856 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:49:48.714856 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:49:48.714856 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:49:48.714856 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:49:48.714856 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:49:48.714856 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 Jul 05 03:49:48.714856 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:49:48.714856 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:49:48.714856 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:49:48.714856 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:49:48.714856 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-349583ee-2c02-4c07-a6a5-82a2b9ee11fb Jul 05 03:49:48.714856 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:49:48.714856 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:49:48.714856 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 Jul 05 03:49:48.714856 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:49:48.714856 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:49:48.714856 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:49:48.714856 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:49:48.714856 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 Jul 05 03:49:48.714856 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:49:48.714856 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:49:48.714856 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:49:48.714856 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:49:48.714856 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:49:48.714856 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:49:48.714856 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:49:48.715667 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:49:48.715667 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:49:48.715667 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:49:48.716124 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-349583ee-2c02-4c07-a6a5-82a2b9ee11fb', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:49:48.738777 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] iscsiadm ('-m', 'session'): stdout=tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:48.738777 np0000004562 cinder-backup[101413]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:48.738777 np0000004562 cinder-backup[101413]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:49:48.738777 np0000004562 cinder-backup[101413]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:49:48.738777 np0000004562 cinder-backup[101413]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:48.738777 np0000004562 cinder-backup[101413]: tcp: [227] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:48.738777 np0000004562 cinder-backup[101413]: tcp: [228] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-349583ee-2c02-4c07-a6a5-82a2b9ee11fb (non-flash) Jul 05 03:49:48.738777 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:49:48.739483 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] iscsi session list stdout=tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:48.739483 np0000004562 cinder-backup[101413]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:48.739483 np0000004562 cinder-backup[101413]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:49:48.739483 np0000004562 cinder-backup[101413]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:49:48.739483 np0000004562 cinder-backup[101413]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:48.739483 np0000004562 cinder-backup[101413]: tcp: [227] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:48.739483 np0000004562 cinder-backup[101413]: tcp: [228] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-349583ee-2c02-4c07-a6a5-82a2b9ee11fb (non-flash) Jul 05 03:49:48.739483 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:49:48.740075 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9', '222'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9', '223'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8', '224'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8', '225'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325', '226'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325', '227'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-349583ee-2c02-4c07-a6a5-82a2b9ee11fb', '228')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:49:48.740400 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-349583ee-2c02-4c07-a6a5-82a2b9ee11fb, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-349583ee-2c02-4c07-a6a5-82a2b9ee11fb', '228')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:49:48.741484 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Resulting device map defaultdict(. at 0x72a47001db20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-349583ee-2c02-4c07-a6a5-82a2b9ee11fb'): ({'sdh'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:49:48.741953 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Removing single pathed devices sdh {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:49:48.752085 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Flushing IO for device /dev/sdh {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:49:48.759883 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:49:48.802834 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Checking to see if SCSI volumes sdh have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:49:48.802834 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] SCSI volumes sdh have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:49:48.802834 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Checking to see if device paths {'sdh'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:49:48.813744 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Device paths {'sdh'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:49:48.814237 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-349583ee-2c02-4c07-a6a5-82a2b9ee11fb')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:49:48.824579 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:48.860675 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 228, target: iqn.2023-03.storpool.com:os--volume-349583ee-2c02-4c07-a6a5-82a2b9ee11fb, portal: 192.168.40.100,3260] Jul 05 03:49:48.860675 np0000004562 cinder-backup[101413]: Logout of [sid: 228, target: iqn.2023-03.storpool.com:os--volume-349583ee-2c02-4c07-a6a5-82a2b9ee11fb, portal: 192.168.40.100,3260] successful. Jul 05 03:49:48.860675 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:48.875874 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:48.875874 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.175s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:49:48.876085 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] <== disconnect_volume: return (176ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:49:49.896525 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-88de3443-30d8-4a13-99fe-9bbaa8658cb5 tempest-ProjectReaderTests33-1605075867 None] Create backup finished. backup: 0fb098e1-7ce9-4b97-ae94-e28560a3009d. Jul 05 03:49:51.551781 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Create backup started, backup: 26336c38-50b4-4658-a99a-2c764d3fabee volume: 7459619f-bc7a-456c-9d26-150e36f69279. Jul 05 03:49:51.557249 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T03:49:51Z,data_timestamp=2026-07-05T03:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-1504317329',encryption_key_id=None,fail_reason=None,host='np0000004562',id=26336c38-50b4-4658-a99a-2c764d3fabee,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='d87c99eeab2f4b1da9cfddf03f0cb8b9',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='2ad4e04899004f869203dfc0cc31f944',volume_id=7459619f-bc7a-456c-9d26-150e36f69279) Jul 05 03:49:51.583127 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_d87c99eeab2f4b1da9cfddf03f0cb8b9 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:49:51.583509 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:49:51.583863 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:49:51.594114 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:49:51.613091 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:49:51.626047 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:49:51.626504 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:49:51.635043 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:49:51.636684 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fec8:e38e', 'fe80::d8a1:37ff:feaa:ab63', 'fe80::f816:3eff:fec3:297f', 'fe80::e477:baff:fee9:cab5', 'fe80::f816:3eff:fe39:e95c', 'fe80::fcb0:ddff:fe37:cbb8'] Jul 05 03:49:51.637099 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:49:51.637331 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:49:51.637678 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] <== get_connector_properties: return (53ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:49:52.142977 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:49:52.143389 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7459619f-bc7a-456c-9d26-150e36f69279', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7459619f-bc7a-456c-9d26-150e36f69279', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:49:52.143583 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:49:52.144117 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:49:52.144408 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7459619f-bc7a-456c-9d26-150e36f69279', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7459619f-bc7a-456c-9d26-150e36f69279', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:49:52.154288 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7459619f-bc7a-456c-9d26-150e36f69279" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:49:52.154729 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7459619f-bc7a-456c-9d26-150e36f69279" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:49:52.154959 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:49:52.164012 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:49:52.164012 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:52.173922 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7459619f-bc7a-456c-9d26-150e36f69279] added Jul 05 03:49:52.173922 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:49:52.173922 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:49:52.173922 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:49:52.173922 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:49:52.173922 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:49:52.173922 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:52.174342 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:49:52.174586 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0195(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:49:52.174796 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:49:53.176063 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-7459619f-bc7a-456c-9d26-150e36f69279 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:49:53.186365 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:53.197067 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:53.209824 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] iscsiadm ('-m', 'session'): stdout=tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:53.209824 np0000004562 cinder-backup[101413]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:53.209824 np0000004562 cinder-backup[101413]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:49:53.209824 np0000004562 cinder-backup[101413]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:49:53.209824 np0000004562 cinder-backup[101413]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:53.209824 np0000004562 cinder-backup[101413]: tcp: [227] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:53.209824 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:49:53.210021 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] iscsi session list stdout=tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:53.210021 np0000004562 cinder-backup[101413]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:53.210021 np0000004562 cinder-backup[101413]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:49:53.210021 np0000004562 cinder-backup[101413]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:49:53.210021 np0000004562 cinder-backup[101413]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:53.210021 np0000004562 cinder-backup[101413]: tcp: [227] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:53.210021 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:49:53.250042 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7459619f-bc7a-456c-9d26-150e36f69279, portal: 192.168.40.100,3260] Jul 05 03:49:53.250042 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7459619f-bc7a-456c-9d26-150e36f69279, portal: 192.168.40.100,3260] successful. Jul 05 03:49:53.250042 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:53.260014 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:49:53.272180 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] iscsiadm ('-m', 'session'): stdout=tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:53.272180 np0000004562 cinder-backup[101413]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:53.272180 np0000004562 cinder-backup[101413]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:49:53.272180 np0000004562 cinder-backup[101413]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:49:53.272180 np0000004562 cinder-backup[101413]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:53.272180 np0000004562 cinder-backup[101413]: tcp: [227] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:53.272180 np0000004562 cinder-backup[101413]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7459619f-bc7a-456c-9d26-150e36f69279 (non-flash) Jul 05 03:49:53.272180 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:49:53.272417 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] iscsi session list stdout=tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:53.272417 np0000004562 cinder-backup[101413]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:49:53.272417 np0000004562 cinder-backup[101413]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:49:53.272417 np0000004562 cinder-backup[101413]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:49:53.272417 np0000004562 cinder-backup[101413]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:53.272417 np0000004562 cinder-backup[101413]: tcp: [227] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:49:53.272417 np0000004562 cinder-backup[101413]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7459619f-bc7a-456c-9d26-150e36f69279 (non-flash) Jul 05 03:49:53.272417 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:49:53.272685 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7459619f-bc7a-456c-9d26-150e36f69279" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.118s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:49:53.272889 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:49:53.273865 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] HCTL ('13', '-', '-', 0) found on session 229 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:49:53.274016 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Scanning host 13 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:49:53.285007 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Searching for a device in session 229 and hctl ['13', '*', '*', 0] yield: None {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:49:54.285222 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Searching for a device in session 229 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:49:54.285781 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7459619f-bc7a-456c-9d26-150e36f69279', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7459619f-bc7a-456c-9d26-150e36f69279', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:49:54.286028 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.142s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:49:54.286204 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] <== connect_volume: return (2142ms) {'type': 'block', 'scsi_wwn': '330000000c8847135', 'path': '/dev/sdh'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:49:54.286514 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:49:54.304969 np0000004562 sudo[155749]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh Jul 05 03:49:54.305595 np0000004562 sudo[155749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:49:54.606045 np0000004562 sudo[155749]: pam_unix(sudo:session): session closed for user root Jul 05 03:49:54.608025 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh" returned: 0 in 0.321s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:49:54.645182 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:49:54.651290 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] _create_container started, container: volumebackups,backup: 26336c38-50b4-4658-a99a-2c764d3fabee. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:49:54.676302 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] generate_object_name_prefix: volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:49:54.680344 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] starting backup of volume: 7459619f-bc7a-456c-9d26-150e36f69279, volume size: 1073741824, object names prefix volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:49:54.858318 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:55.103362 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:55.103575 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:55.202653 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:55.202987 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:55.381509 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:55.616251 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:55.616479 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:55.715450 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:55.715591 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:55.890876 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:56.131158 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:56.131283 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:56.229026 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:56.229188 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:56.452372 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:56.693305 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:56.693471 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:56.795725 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:56.795941 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:56.968452 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:57.211113 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:57.211335 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:57.309736 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:57.309920 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:57.489195 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:57.726783 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:57.726919 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:57.823464 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:57.823701 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:58.001665 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:58.251647 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:58.251884 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:58.354683 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:58.354683 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:58.556313 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:58.802431 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:58.802431 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:58.905233 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:58.905233 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:59.097006 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:59.334214 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:59.334214 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:59.432141 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:59.432141 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:49:59.590672 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:49:59.831542 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:49:59.831542 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:49:59.932331 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:49:59.932331 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:00.116237 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:00.355086 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:00.355086 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:00.456928 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:00.456928 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:00.654411 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:00.895044 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:00.895044 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:00.992932 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:00.992932 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:01.172654 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:01.422849 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:01.422849 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:01.524326 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:01.524505 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:01.720582 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:01.958611 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:01.958795 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:02.059035 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:02.059230 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:02.254860 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:02.494279 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:02.494506 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:02.593528 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:02.593677 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:02.792204 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:03.029329 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:03.029438 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:03.129646 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:03.129902 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:03.312173 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:03.554391 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:03.554625 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:03.651608 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:03.651831 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:03.845464 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:04.081451 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:04.081677 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:04.178966 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:04.179153 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:04.373182 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:04.618405 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:04.618541 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:04.714411 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:04.714610 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:04.937182 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:05.179621 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:05.179806 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:05.280734 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:05.280865 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:05.382676 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:05.502971 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:05.503093 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:05.562051 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:05.562304 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:05.569536 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:50:05.574856 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:50:05.575016 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:50:05.578861 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:50:05.578994 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:50:05.581999 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:50:05.582318 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:50:05.638659 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:50:05.639373 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] _write_metadata started, container name: volumebackups, metadata filename: volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:50:05.662030 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "26336c38-50b4-4658-a99a-2c764d3fabee",\n "backup_name": "tempest-type-Backup-1504317329",\n "created_at": "2026-07-05 03:49:52+00:00",\n "objects": [\n {\n "volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "7459619f-bc7a-456c-9d26-150e36f69279",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"7459619f-bc7a-456c-9d26-150e36f69279\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"2ad4e04899004f869203dfc0cc31f944\\", \\"project_id\\": \\"d87c99eeab2f4b1da9cfddf03f0cb8b9\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:49:50.000000\\", \\"launched_at\\": \\"2026-07-05T03:49:51.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-495349417\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:49:50.000000\\", \\"updated_at\\": \\"2026-07-05T03:49:52.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:50:05.667028 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] backup 26336c38-50b4-4658-a99a-2c764d3fabee finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:50:05.796989 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:50:05.817672 np0000004562 sudo[155763]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh Jul 05 03:50:05.818406 np0000004562 sudo[155763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:50:06.117481 np0000004562 sudo[155763]: pam_unix(sudo:session): session closed for user root Jul 05 03:50:06.119732 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh" returned: 0 in 0.322s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:50:06.120469 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7459619f-bc7a-456c-9d26-150e36f69279', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7459619f-bc7a-456c-9d26-150e36f69279', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000c8847135', 'path': '/dev/sdh'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:50:06.120694 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:50:06.121235 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:50:06.121651 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7459619f-bc7a-456c-9d26-150e36f69279', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7459619f-bc7a-456c-9d26-150e36f69279', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:50:06.133510 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:50:06.133510 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:50:06.133510 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:50:06.133510 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:50:06.133510 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:50:06.133510 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-7459619f-bc7a-456c-9d26-150e36f69279 Jul 05 03:50:06.133510 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:50:06.133510 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:50:06.133510 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 Jul 05 03:50:06.133510 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:50:06.133510 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:50:06.133510 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:50:06.133510 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:50:06.133510 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 Jul 05 03:50:06.133510 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:50:06.133510 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:50:06.133510 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:50:06.133510 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:50:06.133510 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 Jul 05 03:50:06.133510 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:50:06.133510 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:50:06.133510 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:50:06.133510 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:50:06.133510 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:50:06.133510 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:50:06.133510 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:50:06.134072 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:50:06.134072 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:50:06.134072 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:50:06.134153 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7459619f-bc7a-456c-9d26-150e36f69279', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:50:06.157427 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] iscsiadm ('-m', 'session'): stdout=tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:50:06.157427 np0000004562 cinder-backup[101413]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:50:06.157427 np0000004562 cinder-backup[101413]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:50:06.157427 np0000004562 cinder-backup[101413]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:50:06.157427 np0000004562 cinder-backup[101413]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:50:06.157427 np0000004562 cinder-backup[101413]: tcp: [227] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:50:06.157427 np0000004562 cinder-backup[101413]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7459619f-bc7a-456c-9d26-150e36f69279 (non-flash) Jul 05 03:50:06.157427 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:50:06.157754 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] iscsi session list stdout=tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:50:06.157754 np0000004562 cinder-backup[101413]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9 (non-flash) Jul 05 03:50:06.157754 np0000004562 cinder-backup[101413]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:50:06.157754 np0000004562 cinder-backup[101413]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:50:06.157754 np0000004562 cinder-backup[101413]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:50:06.157754 np0000004562 cinder-backup[101413]: tcp: [227] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:50:06.157754 np0000004562 cinder-backup[101413]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7459619f-bc7a-456c-9d26-150e36f69279 (non-flash) Jul 05 03:50:06.157754 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:50:06.157894 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9', '222'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-527192f4-f7d6-4d90-80af-be088e5454f9', '223'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8', '224'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8', '225'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325', '226'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325', '227'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7459619f-bc7a-456c-9d26-150e36f69279', '229')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:50:06.157960 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7459619f-bc7a-456c-9d26-150e36f69279, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7459619f-bc7a-456c-9d26-150e36f69279', '229')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:50:06.159027 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Resulting device map defaultdict(. at 0x72a46fd2a8e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7459619f-bc7a-456c-9d26-150e36f69279'): ({'sdh'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:50:06.159267 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Removing single pathed devices sdh {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:50:06.167896 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Flushing IO for device /dev/sdh {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:50:06.175639 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:50:06.226194 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Checking to see if SCSI volumes sdh have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:50:06.226391 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] SCSI volumes sdh have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:50:06.227633 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Checking to see if device paths {'sdh'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:50:06.237947 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Device paths {'sdh'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:50:06.238186 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7459619f-bc7a-456c-9d26-150e36f69279')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:50:06.248821 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:50:06.288985 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 229, target: iqn.2023-03.storpool.com:os--volume-7459619f-bc7a-456c-9d26-150e36f69279, portal: 192.168.40.100,3260] Jul 05 03:50:06.288985 np0000004562 cinder-backup[101413]: Logout of [sid: 229, target: iqn.2023-03.storpool.com:os--volume-7459619f-bc7a-456c-9d26-150e36f69279, portal: 192.168.40.100,3260] successful. Jul 05 03:50:06.288985 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:50:06.306125 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:50:06.306400 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.185s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:50:06.306565 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] <== disconnect_volume: return (185ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:50:07.327400 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-1f8a372a-9a21-4e23-bb6e-7d1492981081 tempest-ProjectReaderTests33-1605075867 None] Create backup finished. backup: 26336c38-50b4-4658-a99a-2c764d3fabee. Jul 05 03:50:07.895914 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-c3faf57f-226f-43a7-aa0e-1f2b85980948 tempest-ProjectReaderTests33-1605075867 None] Export record started, backup: 26336c38-50b4-4658-a99a-2c764d3fabee. Jul 05 03:50:07.901597 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-c3faf57f-226f-43a7-aa0e-1f2b85980948 tempest-ProjectReaderTests33-1605075867 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_d87c99eeab2f4b1da9cfddf03f0cb8b9 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:50:07.901853 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-c3faf57f-226f-43a7-aa0e-1f2b85980948 tempest-ProjectReaderTests33-1605075867 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:50:07.902275 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-c3faf57f-226f-43a7-aa0e-1f2b85980948 tempest-ProjectReaderTests33-1605075867 None] Export record finished, backup 26336c38-50b4-4658-a99a-2c764d3fabee exported. Jul 05 03:50:10.875701 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:50:10.880783 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Create backup started, backup: 15d5838c-ec5a-4b52-97f2-82396ddfc2f4 volume: b7c69ff4-5f13-4c93-a76e-696866e48fb6. Jul 05 03:50:10.884436 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T03:50:10Z,data_timestamp=2026-07-05T03:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-1171171048',encryption_key_id=None,fail_reason=None,host='np0000004562',id=15d5838c-ec5a-4b52-97f2-82396ddfc2f4,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='d87c99eeab2f4b1da9cfddf03f0cb8b9',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='2ad4e04899004f869203dfc0cc31f944',volume_id=b7c69ff4-5f13-4c93-a76e-696866e48fb6) Jul 05 03:50:10.904196 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_d87c99eeab2f4b1da9cfddf03f0cb8b9 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:50:10.904373 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:50:10.904690 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:50:10.914030 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:50:10.931819 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:50:10.944318 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:50:10.944564 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:50:10.951949 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:50:10.952970 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:fec3:297f', 'fe80::e477:baff:fee9:cab5', 'fe80::f816:3eff:fe39:e95c', 'fe80::fcb0:ddff:fe37:cbb8'] Jul 05 03:50:10.953128 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:50:10.953247 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:50:10.953470 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] <== get_connector_properties: return (48ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:50:11.457439 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:50:11.457974 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7c69ff4-5f13-4c93-a76e-696866e48fb6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7c69ff4-5f13-4c93-a76e-696866e48fb6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:50:11.458219 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:50:11.458816 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:50:11.459108 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7c69ff4-5f13-4c93-a76e-696866e48fb6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7c69ff4-5f13-4c93-a76e-696866e48fb6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:50:11.472148 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b7c69ff4-5f13-4c93-a76e-696866e48fb6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:50:11.472426 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b7c69ff4-5f13-4c93-a76e-696866e48fb6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:50:11.472618 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:50:11.483101 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:50:11.483101 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:50:11.495022 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b7c69ff4-5f13-4c93-a76e-696866e48fb6] added Jul 05 03:50:11.495022 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:50:11.495022 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:50:11.495022 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:50:11.495022 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:50:11.495022 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:50:11.495022 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:50:11.495274 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:50:11.495622 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0229(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:50:11.495805 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:50:11.793062 np0000004562 cinder-backup[101413]: DEBUG oslo_service.periodic_task [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:50:11.793204 np0000004562 cinder-backup[101413]: DEBUG cinder.manager [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Notifying Schedulers of capabilities ... {{(pid=101413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:50:12.497061 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-b7c69ff4-5f13-4c93-a76e-696866e48fb6 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:50:12.507659 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:50:12.516989 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:50:12.529103 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] iscsiadm ('-m', 'session'): stdout=tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:50:12.529103 np0000004562 cinder-backup[101413]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:50:12.529103 np0000004562 cinder-backup[101413]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:50:12.529103 np0000004562 cinder-backup[101413]: tcp: [227] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:50:12.529103 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:50:12.529327 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] iscsi session list stdout=tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:50:12.529327 np0000004562 cinder-backup[101413]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:50:12.529327 np0000004562 cinder-backup[101413]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:50:12.529327 np0000004562 cinder-backup[101413]: tcp: [227] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:50:12.529327 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:50:12.560050 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b7c69ff4-5f13-4c93-a76e-696866e48fb6, portal: 192.168.40.100,3260] Jul 05 03:50:12.560050 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b7c69ff4-5f13-4c93-a76e-696866e48fb6, portal: 192.168.40.100,3260] successful. Jul 05 03:50:12.560050 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:50:12.569703 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:50:12.583185 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] iscsiadm ('-m', 'session'): stdout=tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:50:12.583185 np0000004562 cinder-backup[101413]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:50:12.583185 np0000004562 cinder-backup[101413]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:50:12.583185 np0000004562 cinder-backup[101413]: tcp: [227] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:50:12.583185 np0000004562 cinder-backup[101413]: tcp: [230] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c69ff4-5f13-4c93-a76e-696866e48fb6 (non-flash) Jul 05 03:50:12.583185 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:50:12.583463 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] iscsi session list stdout=tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:50:12.583463 np0000004562 cinder-backup[101413]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:50:12.583463 np0000004562 cinder-backup[101413]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:50:12.583463 np0000004562 cinder-backup[101413]: tcp: [227] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:50:12.583463 np0000004562 cinder-backup[101413]: tcp: [230] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c69ff4-5f13-4c93-a76e-696866e48fb6 (non-flash) Jul 05 03:50:12.583463 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:50:12.583787 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b7c69ff4-5f13-4c93-a76e-696866e48fb6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.111s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:50:12.583906 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:50:12.584833 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] HCTL ('8', '-', '-', 0) found on session 230 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:50:12.585038 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Scanning host 8 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:50:12.598224 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Searching for a device in session 230 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:50:12.598224 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7c69ff4-5f13-4c93-a76e-696866e48fb6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7c69ff4-5f13-4c93-a76e-696866e48fb6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:50:13.600555 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.142s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:50:13.601115 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] <== connect_volume: return (2143ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799247', 'path': '/dev/sdc'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:50:13.601115 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:50:13.617677 np0000004562 sudo[155987]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc Jul 05 03:50:13.618344 np0000004562 sudo[155987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:50:13.915883 np0000004562 sudo[155987]: pam_unix(sudo:session): session closed for user root Jul 05 03:50:13.917838 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc" returned: 0 in 0.316s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:50:13.955925 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:50:13.962063 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] _create_container started, container: volumebackups,backup: 15d5838c-ec5a-4b52-97f2-82396ddfc2f4. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:50:13.989046 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] generate_object_name_prefix: volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4 {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:50:13.993458 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] starting backup of volume: b7c69ff4-5f13-4c93-a76e-696866e48fb6, volume size: 1073741824, object names prefix volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:50:14.171226 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:14.415126 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:14.415316 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:14.512181 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:14.512348 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:14.692229 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:14.930796 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:14.930951 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:15.026076 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:15.026227 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:15.204242 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:15.457164 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:15.457432 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:15.559783 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:15.559934 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:15.753896 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:15.997630 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:15.997934 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:16.112520 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:16.112642 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:16.317200 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:16.557339 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:16.557473 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:16.656886 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:16.657049 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:16.835544 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:17.089363 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:17.089558 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:17.188109 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:17.188109 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:17.388461 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:17.636390 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:17.636544 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:17.734379 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:17.734632 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:17.916528 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:18.153041 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:18.153243 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:18.252543 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:18.252724 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:18.433952 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:18.680609 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:18.680752 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:18.782455 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:18.782618 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:18.964726 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:19.207808 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:19.207912 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:19.306397 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:19.306555 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:19.448854 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Create backup started, backup: b278a846-a6ff-4fc6-9cae-dd99d2be1fd1 volume: b5113927-f7d6-4561-bd3f-c758db6d8325. Jul 05 03:50:19.453199 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T03:50:19Z,data_timestamp=2026-07-05T03:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1661982877',encryption_key_id=None,fail_reason=None,host='np0000004562',id=b278a846-a6ff-4fc6-9cae-dd99d2be1fd1,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(43a13ec7-8bb2-4118-96f0-671b8f175e1f),parent_id='43a13ec7-8bb2-4118-96f0-671b8f175e1f',project_id='2ee62c33d51844a9a90e9a9e640d703b',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='ea1163b57d574d8c9031fe9c82c96b2c',volume_id=b5113927-f7d6-4561-bd3f-c758db6d8325) Jul 05 03:50:19.479202 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_2ee62c33d51844a9a90e9a9e640d703b {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:50:19.479601 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:50:19.479997 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:50:19.492589 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:50:19.503287 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:19.512460 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:50:19.528664 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:50:19.530748 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:50:19.537940 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:50:19.538510 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544'] Jul 05 03:50:19.538943 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:50:19.538943 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:50:19.539078 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] <== get_connector_properties: return (58ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:50:19.783005 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:19.783193 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:19.884332 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:19.884455 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:19.921108 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:50:20.045824 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:50:20.046762 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5113927-f7d6-4561-bd3f-c758db6d8325', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:50:20.046762 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:50:20.047546 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:50:20.047682 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5113927-f7d6-4561-bd3f-c758db6d8325', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:50:20.060914 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:50:20.061370 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:50:20.061657 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:50:20.072541 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:50:20.072541 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:50:20.083548 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325] added Jul 05 03:50:20.083548 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:50:20.083548 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:50:20.083548 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:50:20.083548 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:50:20.083548 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:50:20.083548 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:50:20.083838 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:50:20.084155 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0225(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:50:20.084375 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:50:20.108949 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:20.350541 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:20.350725 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:20.451880 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:20.452088 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:20.624399 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:20.867225 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:20.867385 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:20.965110 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:20.965284 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:21.085429 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:50:21.096967 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:50:21.108888 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:50:21.127305 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('-m', 'session'): stdout=tcp: [230] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c69ff4-5f13-4c93-a76e-696866e48fb6 (non-flash) Jul 05 03:50:21.127305 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:50:21.127535 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] iscsi session list stdout=tcp: [230] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c69ff4-5f13-4c93-a76e-696866e48fb6 (non-flash) Jul 05 03:50:21.127535 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:50:21.156563 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325, portal: 192.168.40.100,3260] Jul 05 03:50:21.156563 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325, portal: 192.168.40.100,3260] successful. Jul 05 03:50:21.156563 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:50:21.164086 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:21.167279 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:50:21.179285 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('-m', 'session'): stdout=tcp: [230] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c69ff4-5f13-4c93-a76e-696866e48fb6 (non-flash) Jul 05 03:50:21.179285 np0000004562 cinder-backup[101413]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:50:21.179285 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:50:21.179460 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] iscsi session list stdout=tcp: [230] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c69ff4-5f13-4c93-a76e-696866e48fb6 (non-flash) Jul 05 03:50:21.179460 np0000004562 cinder-backup[101413]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:50:21.179460 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:50:21.179705 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.118s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:50:21.179910 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:50:21.180482 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] HCTL ('7', '-', '-', 0) found on session 231 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:50:21.180600 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:50:21.196116 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Searching for a device in session 231 and hctl ['7', '*', '*', 0] yield: None {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:50:21.414545 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:21.414693 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:21.512807 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:21.512998 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:21.698173 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:21.939205 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:21.939375 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:22.035066 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:22.035295 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:22.197691 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Searching for a device in session 231 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:50:22.198108 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5113927-f7d6-4561-bd3f-c758db6d8325', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:50:22.198954 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.152s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:50:22.199183 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] <== connect_volume: return (2152ms) {'type': 'block', 'scsi_wwn': '33000000016d0b1f8', 'path': '/dev/sdb'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:50:22.199557 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:50:22.211204 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:22.220741 np0000004562 sudo[156217]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 05 03:50:22.221374 np0000004562 sudo[156217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:50:22.465382 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:22.465512 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:22.502404 np0000004562 sudo[156217]: pam_unix(sudo:session): session closed for user root Jul 05 03:50:22.504197 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.305s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:50:22.509371 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] _read_sha256file started, container name: volumebackups, sha256 filename: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f_sha256file. {{(pid=101413) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:333}} Jul 05 03:50:22.558156 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] _read_sha256file finished. {{(pid=101413) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:340}} Jul 05 03:50:22.565804 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] _create_container started, container: volumebackups,backup: b278a846-a6ff-4fc6-9cae-dd99d2be1fd1. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:50:22.569027 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:22.569162 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:22.608245 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] generate_object_name_prefix: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1 {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:50:22.612965 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] starting backup of volume: b5113927-f7d6-4561-bd3f-c758db6d8325, volume size: 1073741824, object names prefix volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:50:22.862136 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:22.886192 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:22.886879 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 32768 bytes of data to 639 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:22.886999 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:22.910360 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00001: 7455b0146d203e0450dd14035351df50 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:22.910530 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:22.910975 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:22.915890 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 294912 bytes of data to 26763 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:22.916017 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:22.938050 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00002: fe5da92e67dfd4c9a34ca9f93fe80fcc {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:22.938222 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:22.940219 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:22.964390 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 2228224 bytes of data to 111964 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:22.964632 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:22.990395 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00003: 215382887039953a4711d9a726d308f7 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:22.990587 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:22.991098 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:22.992776 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 98304 bytes of data to 3974 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:22.992954 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:23.014663 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00004: e1554f9208060479cb8c0e2b20ce3092 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:23.014859 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:23.015367 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:23.020588 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 360448 bytes of data to 34483 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:23.020706 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:23.046806 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00005: 260e04b2b4be4a8fb9af5bcaeef77f5e {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:23.047027 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:23.047631 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:23.052313 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 262144 bytes of data to 36108 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:23.052491 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:23.074934 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00006: 7e4882497657c646c554c5ad835c0cf5 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:23.075126 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:23.075411 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:23.076254 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 32768 bytes of data to 338 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:23.076408 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:23.098171 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00007: d9cd9a4fb7c178bffad872b9fd1c6616 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:23.098331 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:23.098901 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:23.110249 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:23.110401 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:23.121552 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 524288 bytes of data to 272574 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:23.121756 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:23.145439 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00008: 89771b482f431367ab05882b853a01a6 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:23.145580 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:23.145971 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:23.148391 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 98304 bytes of data to 18814 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:23.148502 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:23.168440 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00009: 807f8f1c74646a8f9592027f16d2643d {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:23.168594 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:23.168792 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:23.170010 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 65536 bytes of data to 21396 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:23.170163 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:23.192011 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00010: 035de9616151b09d26063aaf3786be98 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:23.192149 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:23.192629 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:23.208511 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 327680 bytes of data to 158643 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:23.208922 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:23.210468 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:23.210630 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:23.237453 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00011: f941eba3270410ec15b7aff819b8b0c0 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:23.237582 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:23.237962 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:23.248337 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 327680 bytes of data to 62614 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:23.248561 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:23.272637 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00012: ba683c210943a225502816568e3b8d00 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:23.272805 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:23.273006 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:23.275204 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 65536 bytes of data to 14711 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:23.275330 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:23.301203 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00013: e88548713f69de90eef0cd6c4e9796dd {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:23.301357 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:23.301914 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:23.314856 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 393216 bytes of data to 90143 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:23.315082 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:23.340257 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00014: 01e3e2d3510c4223690a6849e71496ab {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:23.340378 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:23.340621 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:23.345103 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 131072 bytes of data to 34865 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:23.345289 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:23.375068 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00015: 599805a91aa71f961c3787a61e7c5729 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:23.375199 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:23.375402 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:23.377234 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 65536 bytes of data to 7444 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:23.377402 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:23.399723 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00016: 179b961161bdaa477c7c01ad80585eee {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:23.399908 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:23.400142 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:23.408506 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 131072 bytes of data to 83926 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:23.408725 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:23.416551 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:23.431127 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00017: d27aa048e7ec9b4cbc6afc435ead70f6 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:23.431252 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:23.431934 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:23.459137 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 786432 bytes of data to 349723 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:23.459293 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:23.485632 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00018: 93a49a74b3f385db27466765f9e213d9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:23.485779 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:23.486131 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:23.489465 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 65536 bytes of data to 30511 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:23.489589 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:23.508494 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00019: fb0b4c9f443eae7a19740e071a10002c {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:23.508618 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:23.510617 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:23.598661 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 2293760 bytes of data to 749876 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:23.598833 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:23.635734 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00020: fc804896bdfc39ce809d6d5f4c3d9ec0 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:23.635919 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:23.636565 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:23.647622 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 262144 bytes of data to 60945 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:23.647831 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:23.657513 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:23.657637 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:23.669596 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00021: 600a0ec270d9626014f041f394a91dec {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:23.669763 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:23.669923 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:23.672805 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 65536 bytes of data to 21497 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:23.672935 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:23.692665 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00022: d74672ad69032d6511c7f86b7b0cdb23 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:23.692844 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:23.693037 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:23.696078 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 98304 bytes of data to 16500 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:23.696216 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:23.714928 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00023: b26d859ed07de20dd16d0c165a4e6a3a {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:23.715094 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:23.715507 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:23.724652 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 294912 bytes of data to 60530 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:23.724794 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:23.744212 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00024: 17812a659c805b2d08ad0ffbac17f523 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:23.744342 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:23.744616 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:23.746589 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 65536 bytes of data to 18150 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:23.746724 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:23.751726 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:23.751927 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:23.768467 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00025: 900ba3be5febaa4a7e8d4fe06a9e5bbe {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:23.768678 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:23.768905 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:23.770350 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 32768 bytes of data to 5224 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:23.770729 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:23.794765 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00026: 7b83ad270600f54dc0ce5f973398f4a1 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:23.795020 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:23.795291 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:23.796582 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 32768 bytes of data to 7895 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:23.796703 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:23.820559 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00027: a31179c9f17d2086e474bbff2d8b9fa5 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:23.820696 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:23.820915 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:23.823834 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 98304 bytes of data to 16089 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:23.823990 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:23.844869 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00028: 86d6719d73ca0214c25634aedc7fe9d9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:23.844991 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:23.845190 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:23.848726 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 98304 bytes of data to 19002 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:23.848899 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:23.872538 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00029: fdf44fcafc023cb46fe41182b8e073b8 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:23.872669 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:23.873197 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:23.893529 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 524288 bytes of data to 110895 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:23.893682 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:23.917426 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00030: 5815c96da9bc9be47f2dde7f69ddd130 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:23.917583 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:23.917907 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:23.923720 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 131072 bytes of data to 37108 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:23.923900 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:23.931591 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:23.944883 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00031: 7ecd5b62ea9a77dd27d5058cc0b2af3a {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:23.945111 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:23.945608 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:23.954360 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 294912 bytes of data to 57886 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:23.954479 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:23.975425 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00032: 185eea5b60ee84638ea2ef67b051e400 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:23.975551 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:23.975809 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:23.977216 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 32768 bytes of data to 6526 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:23.977334 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:23.999599 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00033: e41a77e44d240ad8104d5fb9712151e4 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:23.999758 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:23.999956 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:24.002551 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 65536 bytes of data to 14907 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:24.002670 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:24.027556 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00034: a7a0eee90ff873fe50f294cf33e7de2d {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:24.027806 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:24.028080 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:24.032775 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 65536 bytes of data to 32515 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:24.032969 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:24.052737 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00035: 5a96fd0be63a553958c90d4a4316c4de {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:24.052876 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:24.053060 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:24.055619 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 98304 bytes of data to 13305 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:24.055650 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:24.079062 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00036: b02b4173598f30151430937bc55a6faf {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:24.079218 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:24.079634 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:24.091199 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 262144 bytes of data to 90046 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:24.091326 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:24.113603 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00037: b7e2d07e021e740544325541d67b7329 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:24.113863 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:24.114247 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:24.115202 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 32768 bytes of data to 2818 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:24.115392 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:24.135492 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00038: 00fb2cc13328ca425a2eca1e6c7c4e6d {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:24.135646 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:24.135836 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:24.136982 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 32768 bytes of data to 5756 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:24.137109 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:24.157465 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00039: d11036511ad7f5dbe776a742c58f87ea {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:24.157594 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:24.157739 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:24.158374 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 32768 bytes of data to 1906 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:24.158484 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:24.177241 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00040: c4ed5bf65e3847ac3a3103aeb9f043f9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:24.177358 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:24.177507 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:24.178905 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 32768 bytes of data to 6858 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:24.179015 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:24.180658 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:24.180840 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:24.204591 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00041: 2abba25a77ee36c58131400ef11e9b33 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:24.204682 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:24.204935 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:24.208617 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 65536 bytes of data to 15768 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:24.209218 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:24.228773 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00042: 58c33934aea3dc04d999003f5971d3e1 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:24.228773 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:24.228868 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:24.231447 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 65536 bytes of data to 10944 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:24.231581 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:24.250922 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00043: 90971d6560092661366d4a8e0d690316 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:24.251143 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:24.251371 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:24.252552 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 32768 bytes of data to 5153 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:24.252729 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:24.274143 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00044: 6d63cabe5cbd45d0e7748b702fb3237f {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:24.274325 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:24.274565 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:24.281995 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 229376 bytes of data to 56731 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:24.282183 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:24.282609 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:24.282807 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:24.307091 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00045: b63363b73e33269b13a4b9007772caea {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:24.307328 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:24.531115 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:24.559933 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:24.561671 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 32768 bytes of data to 6383 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:24.561871 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:24.584791 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00046: 7ad27b3399ebe8e17313a1edd45d2a4c {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:24.585068 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:24.585241 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:24.588822 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 65536 bytes of data to 29648 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:24.588936 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:24.613784 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00047: b2f4bed0ea8034625ddd32034addd197 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:24.613994 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:24.614255 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:24.616773 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 65536 bytes of data to 11536 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:24.616959 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:24.638674 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00048: e2ae44a38272f3786b389fe25de025f7 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:24.638854 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:24.639063 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:24.647797 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 131072 bytes of data to 60908 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:24.647946 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:24.674241 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00049: 459edd959d71fc76632140b2c1c2afd7 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:24.674381 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:24.674895 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:24.682915 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 262144 bytes of data to 49816 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:24.683033 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:24.711381 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00050: 9f03bd9a5f1f3681ce923853068a5391 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:24.711625 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:24.711994 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:24.713055 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 32768 bytes of data to 3271 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:24.713257 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:24.741847 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00051: 808b8e5ae0ebfa3ebee1f25e56d7380e {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:24.742034 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:24.743725 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:24.777157 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:24.777384 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:24.834855 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 2162688 bytes of data to 713034 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:24.835060 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:24.867816 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00052: 039e5ca2ac2a85e1f145dd61e3971db7 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:24.868096 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:24.868692 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:24.874477 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 131072 bytes of data to 49711 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:24.874623 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:24.877451 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:24.877620 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:24.897818 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00053: ac2c3b7f365746cfcedfa3644641f133 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:24.898065 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:24.898522 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:24.910215 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 262144 bytes of data to 109962 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:24.910400 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:24.934572 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00054: d4e16afa8ee08db846e947df5b4ec08b {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:24.934761 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:24.935083 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:24.949187 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 196608 bytes of data to 106450 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:24.949426 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:24.975198 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:24.980066 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00055: 86d6f3eb5f3f66b3bd977ec8c039a49c {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:24.980245 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:24.980479 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:24.987318 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 196608 bytes of data to 59932 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:24.987463 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:25.008421 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00056: 933534e51561c890b382aa9eb4c5764c {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:25.008636 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:25.008892 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:25.010095 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 32768 bytes of data to 9062 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:25.010215 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:25.041355 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00057: 0f7cdc5b89fbb7316ab86f111715879e {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:25.041355 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:25.041355 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:25.043870 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 65536 bytes of data to 23335 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:25.043870 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:25.068243 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00058: b3534e7bd21436d93d6e15ceae51ecbb {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:25.068415 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:25.068620 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:25.074111 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 65536 bytes of data to 36991 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:25.074310 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:25.095873 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:25.096035 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:25.099095 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00059: 308e5172c7191c405029e68eb339b63e {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:25.099279 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:25.099605 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:25.105410 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 98304 bytes of data to 27296 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:25.105410 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:25.124112 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00060: 87fed698449bb429c84cea142b47074f {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:25.124585 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:25.124585 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:25.125741 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 32768 bytes of data to 6577 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:25.125804 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:25.144095 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00061: 8577057e39906809834d6bbe62984d84 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:25.144219 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:25.145892 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:25.154721 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] backup MD5 for volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:25.154844 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:25.160752 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:50:25.164979 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:50:25.165151 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:50:25.168110 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:50:25.168264 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:50:25.170615 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:50:25.170904 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:50:25.225615 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:50:25.226564 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] _write_metadata started, container name: volumebackups, metadata filename: volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:50:25.247805 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 2162688 bytes of data to 835720 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:25.247914 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:25.250495 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "15d5838c-ec5a-4b52-97f2-82396ddfc2f4",\n "backup_name": "tempest-type-Backup-1171171048",\n "created_at": "2026-07-05 03:50:11+00:00",\n "objects": [\n {\n "volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "b7c69ff4-5f13-4c93-a76e-696866e48fb6",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"b7c69ff4-5f13-4c93-a76e-696866e48fb6\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"2ad4e04899004f869203dfc0cc31f944\\", \\"project_id\\": \\"d87c99eeab2f4b1da9cfddf03f0cb8b9\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:50:10.000000\\", \\"launched_at\\": \\"2026-07-05T03:50:10.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1272652726\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:50:10.000000\\", \\"updated_at\\": \\"2026-07-05T03:50:11.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:50:25.257219 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] backup 15d5838c-ec5a-4b52-97f2-82396ddfc2f4 finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:50:25.383217 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:50:25.396097 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00062: 286f32389d41ccb3a7454011b7fe833b {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:25.396390 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:25.397589 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:25.402274 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 131072 bytes of data to 32835 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:25.402404 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:25.404811 np0000004562 sudo[156220]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc Jul 05 03:50:25.405545 np0000004562 sudo[156220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:50:25.430565 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00063: 07f83a91f2a65593c97ccde75e2cdb1a {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:25.430844 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:25.431148 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:25.431857 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 32768 bytes of data to 258 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:25.432068 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:25.453352 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00064: 472694eb9fd935b65a675e05db84ae55 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:25.453602 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:25.453928 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:25.461427 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 163840 bytes of data to 60928 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:25.461635 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:25.489659 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00065: 7bbd91225a7ad728f1ee251495d662a3 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:25.489898 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:25.490221 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:25.499907 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 196608 bytes of data to 89811 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:25.500151 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:25.522997 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00066: 9c2c443a510acae20e828ca784ea0ef0 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:25.523209 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:25.523423 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:25.524874 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 32768 bytes of data to 10326 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:25.524997 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:25.551380 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00067: f15596026d78fb5a6c33e31e645c1bc0 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:25.551534 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:25.551761 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:25.556776 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 131072 bytes of data to 31811 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:25.556933 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:25.579366 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00068: 01e07b6ff49d49600cff2b5f037b5585 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:25.579592 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:25.579874 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:25.591928 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 196608 bytes of data to 99152 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:25.592151 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:25.618189 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00069: 2cc1e5bb8b0f7f6b8f396071b242c82d {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:25.618376 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:25.620877 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:25.720693 np0000004562 sudo[156220]: pam_unix(sudo:session): session closed for user root Jul 05 03:50:25.722551 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc" returned: 0 in 0.340s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:50:25.723062 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7c69ff4-5f13-4c93-a76e-696866e48fb6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7c69ff4-5f13-4c93-a76e-696866e48fb6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799247', 'path': '/dev/sdc'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:50:25.723253 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:50:25.723661 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:50:25.724042 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7c69ff4-5f13-4c93-a76e-696866e48fb6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7c69ff4-5f13-4c93-a76e-696866e48fb6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:50:25.735428 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:50:25.735428 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:50:25.735428 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:50:25.735428 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:50:25.735428 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:50:25.735428 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-b7c69ff4-5f13-4c93-a76e-696866e48fb6 Jul 05 03:50:25.735428 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:50:25.735428 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:50:25.735428 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 Jul 05 03:50:25.735428 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:50:25.735428 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:50:25.735428 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:50:25.735428 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:50:25.735428 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:50:25.736951 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:50:25.736951 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:50:25.736951 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:50:25.737347 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7c69ff4-5f13-4c93-a76e-696866e48fb6', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:50:25.737802 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 2555904 bytes of data to 1042244 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:25.737939 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:25.758456 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] iscsiadm ('-m', 'session'): stdout=tcp: [230] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c69ff4-5f13-4c93-a76e-696866e48fb6 (non-flash) Jul 05 03:50:25.758456 np0000004562 cinder-backup[101413]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:50:25.758456 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:50:25.758619 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] iscsi session list stdout=tcp: [230] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c69ff4-5f13-4c93-a76e-696866e48fb6 (non-flash) Jul 05 03:50:25.758619 np0000004562 cinder-backup[101413]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:50:25.758619 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:50:25.758787 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7c69ff4-5f13-4c93-a76e-696866e48fb6', '230'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325', '231')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:50:25.758916 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b7c69ff4-5f13-4c93-a76e-696866e48fb6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7c69ff4-5f13-4c93-a76e-696866e48fb6', '230')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:50:25.759824 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Resulting device map defaultdict(. at 0x72a470240b80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7c69ff4-5f13-4c93-a76e-696866e48fb6'): ({'sdc'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:50:25.760041 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Removing single pathed devices sdc {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:50:25.770212 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Flushing IO for device /dev/sdc {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:50:25.777168 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00070: 77a339075c2c22a3b220b8be3eafd00a {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:25.777291 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:25.778139 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:25.778747 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:50:25.789019 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 196608 bytes of data to 64453 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:25.789186 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:25.812699 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00071: 4976e1dea54e67ed34a48147acf51f95 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:25.812839 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:25.813003 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:25.814109 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 32768 bytes of data to 7823 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:25.814249 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:25.838042 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00072: c5102cf8b89d0646b4a8454aa2eb455b {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:25.838233 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:25.838462 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:25.839948 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Checking to see if SCSI volumes sdc have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:50:25.840124 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] SCSI volumes sdc have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:50:25.841090 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Checking to see if device paths {'sdc'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:50:25.845769 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 262144 bytes of data to 50703 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:25.845916 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:25.852314 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Device paths {'sdc'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:50:25.852532 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7c69ff4-5f13-4c93-a76e-696866e48fb6')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:50:25.861644 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:50:25.870579 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00073: a90b39452df564cdaee1875cdf14648d {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:25.870745 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:25.870954 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:25.882193 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 196608 bytes of data to 94089 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:25.882307 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:25.894366 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 230, target: iqn.2023-03.storpool.com:os--volume-b7c69ff4-5f13-4c93-a76e-696866e48fb6, portal: 192.168.40.100,3260] Jul 05 03:50:25.894366 np0000004562 cinder-backup[101413]: Logout of [sid: 230, target: iqn.2023-03.storpool.com:os--volume-b7c69ff4-5f13-4c93-a76e-696866e48fb6, portal: 192.168.40.100,3260] successful. Jul 05 03:50:25.894366 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:50:25.905261 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:50:25.905566 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.182s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:50:25.905785 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] <== disconnect_volume: return (182ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:50:25.909065 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00074: 93190166bf0c7415bc69f707aeecba3d {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:25.909211 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:25.909860 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:25.946296 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 753664 bytes of data to 382335 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:25.946449 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:25.972314 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00075: f20b7ef7942c255d34567ef7a8c931d5 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:25.972456 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:25.974401 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:26.030265 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 1245184 bytes of data to 692194 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:26.030385 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:26.063437 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00076: 2fec27600c3cba1475524f3a83a147d9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:26.063595 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:26.064160 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:26.075443 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 229376 bytes of data to 86155 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:26.075556 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:26.098605 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00077: bd18e2aa13a8966c7ccaeb4a8d2ad111 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:26.098796 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:26.099173 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:26.111069 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 196608 bytes of data to 89989 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:26.111203 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:26.137562 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00078: 2742a11d6ef6f40794ba3a77fdd91fc1 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:26.137732 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:26.138561 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:26.171072 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 753664 bytes of data to 244005 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:26.171299 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:26.195957 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00079: 937919e06f1ac884e907b3b44f7aa3f7 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:26.196134 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:26.196454 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:26.197839 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 32768 bytes of data to 8385 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:26.197952 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:26.219983 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00080: 80bf1a781b69ed6d28f051a8c1bace93 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:26.220191 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:26.220382 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:26.224464 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 98304 bytes of data to 35069 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:26.224597 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:26.247678 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00081: 839ea305330c068b1e25e10bbe0072eb {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:26.248038 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:26.248119 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:26.260214 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 196608 bytes of data to 101460 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:26.260360 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:26.283036 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00082: e35f12e70225bea64f1d64820a8c34af {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:26.283193 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:26.283364 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:26.284318 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 32768 bytes of data to 27789 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:26.284430 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:26.302997 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00083: b64ba69a7c7b92cbb6e034a227c535e1 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:26.303129 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:26.303295 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:26.310826 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 163840 bytes of data to 57870 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:26.310929 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:26.332056 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00084: 7271b184b3a0862c0307275252dd4c26 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:26.332208 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:26.332420 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:26.346258 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 196608 bytes of data to 111151 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:26.346456 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:26.368869 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00085: 534ab1b26cf91adf3fcf3f10f1b565b6 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:26.368996 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:26.369588 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:26.386108 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 524288 bytes of data to 186733 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:26.386387 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:26.412376 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00086: c51969b17b173a09b0699f6aebe1dcd1 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:26.412588 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:26.412990 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:26.414075 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 98304 bytes of data to 3528 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:26.414278 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:26.438282 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00087: d2e25d026c0032ef44bfe4b5a3ee7400 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:26.438441 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:26.438623 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:26.439177 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 32768 bytes of data to 759 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:26.439323 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:26.461111 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00088: 91fa160b3091d130dcb1f7c58f5f6e5a {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:26.461251 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:26.461455 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:26.471792 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 262144 bytes of data to 93620 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:26.471909 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:26.494545 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00089: a77c3df81950fe3ec6756b32c47d5889 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:26.494735 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:26.679741 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:26.681827 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 65536 bytes of data to 14202 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:26.682055 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:26.701746 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00090: c15a2e2eb7fb41df1e140bbf87c78a9c {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:26.701875 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:26.702060 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:26.711894 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 196608 bytes of data to 99711 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:26.712012 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:26.732813 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00091: d2f8fd157e57c49a2e7fbb7db668bdfa {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:26.732947 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:26.733150 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:26.736016 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 65536 bytes of data to 24816 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:26.736153 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:26.757250 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00092: ab4c3c6565d120e31d0ec092b1f40fc0 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:26.757387 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:26.757558 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:26.758830 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 32768 bytes of data to 9379 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:26.758952 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:26.779049 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00093: 6df3fb11329fda670b6a648b803a75c3 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:26.779236 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:26.779422 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:26.780867 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 32768 bytes of data to 11742 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:26.780991 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:26.800371 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00094: d3338725ce0b00d0d0a20c3dc76363b5 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:26.800529 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:26.801125 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:26.825924 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 557056 bytes of data to 231400 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:26.826056 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:26.849435 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00095: 736df86bae8f6a9fbe7631cf877d988c {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:26.849590 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:26.849960 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:26.854881 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 131072 bytes of data to 45214 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:26.855003 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:26.878083 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00096: 5465c211d4134a5c770e5e96d9420f8b {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:26.878257 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:26.878482 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:26.879443 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 32768 bytes of data to 3791 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:26.879563 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:26.898923 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00097: 125fb29df3a88ed91bb536861e7d1ff9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:26.899088 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:26.899297 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:26.902198 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 98304 bytes of data to 26004 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:26.902325 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:26.924773 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-c4edf065-0773-4153-a804-1f2e07c5797b tempest-ProjectReaderTests33-1605075867 None] Create backup finished. backup: 15d5838c-ec5a-4b52-97f2-82396ddfc2f4. Jul 05 03:50:26.925380 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00098: 38a20f8b3afb8be4ea4deab5f9b3d080 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:26.925508 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:26.925675 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:26.930469 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 131072 bytes of data to 34863 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:26.930597 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:26.951687 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00099: f87eeae8e3222a88fc335a905cc595f5 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:26.952161 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:26.952161 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:26.957164 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 131072 bytes of data to 28914 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:26.957294 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:26.979701 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00100: a34ec244a0a06a62255379762d3da663 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:26.979885 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:26.980425 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:27.001295 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 393216 bytes of data to 206685 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:27.001439 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:27.024315 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00101: ce40a8df09b1374e7997af78065811c8 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:27.024548 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:27.024929 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:27.026323 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 32768 bytes of data to 9850 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:27.026488 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:27.045493 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00102: 5649b75a126d07b66d0cec64e48b81cf {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:27.045722 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:27.046123 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:27.046890 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 65536 bytes of data to 427 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:27.047087 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:27.068097 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00103: 7f6e95afedd64afe9d241549e3659811 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:27.068305 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:27.623586 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:27.624233 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 32768 bytes of data to 68 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:27.624380 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:27.646151 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00104: 0ac8838eee7696114147d95e0878e3b2 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:27.646336 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:27.991847 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:27.992501 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 65536 bytes of data to 427 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:27.992636 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:28.012241 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00105: 727482d1b4dc9faeb4c7861fcce524bc {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:28.012404 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:28.346560 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-acf96a4c-986b-4fff-8a62-a0aa04365a47 tempest-ProjectReaderTests33-1605075867 None] Delete backup started, backup: 15d5838c-ec5a-4b52-97f2-82396ddfc2f4. Jul 05 03:50:28.353850 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-acf96a4c-986b-4fff-8a62-a0aa04365a47 tempest-ProjectReaderTests33-1605075867 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_d87c99eeab2f4b1da9cfddf03f0cb8b9 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:50:28.354137 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-acf96a4c-986b-4fff-8a62-a0aa04365a47 tempest-ProjectReaderTests33-1605075867 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:50:28.354352 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-acf96a4c-986b-4fff-8a62-a0aa04365a47 tempest-ProjectReaderTests33-1605075867 None] delete started, backup: 15d5838c-ec5a-4b52-97f2-82396ddfc2f4, container: volumebackups, prefix: volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:50:28.405477 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:50:28.412664 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-acf96a4c-986b-4fff-8a62-a0aa04365a47 tempest-ProjectReaderTests33-1605075867 None] generated object list: ['volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00001', 'volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00002', 'volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00003', 'volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00004', 'volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00005', 'volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00006', 'volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00007', 'volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00008', 'volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00009', 'volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00010', 'volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00011', 'volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00012', 'volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00013', 'volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00014', 'volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00015', 'volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00016', 'volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00017', 'volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00018', 'volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00019', 'volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00020', 'volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00021', 'volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4_metadata', 'volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:50:28.431875 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-acf96a4c-986b-4fff-8a62-a0aa04365a47 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00001 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:28.450161 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-acf96a4c-986b-4fff-8a62-a0aa04365a47 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00002 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:28.469037 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-acf96a4c-986b-4fff-8a62-a0aa04365a47 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00003 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:28.486428 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-acf96a4c-986b-4fff-8a62-a0aa04365a47 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00004 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:28.505409 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-acf96a4c-986b-4fff-8a62-a0aa04365a47 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00005 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:28.524423 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-acf96a4c-986b-4fff-8a62-a0aa04365a47 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00006 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:28.544669 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-acf96a4c-986b-4fff-8a62-a0aa04365a47 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00007 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:28.560177 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-acf96a4c-986b-4fff-8a62-a0aa04365a47 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00008 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:28.577476 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-acf96a4c-986b-4fff-8a62-a0aa04365a47 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00009 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:28.584773 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:28.585250 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 32768 bytes of data to 68 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:28.585363 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:28.594273 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-acf96a4c-986b-4fff-8a62-a0aa04365a47 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00010 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:28.610541 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00106: 0ac8838eee7696114147d95e0878e3b2 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:28.610669 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:28.612679 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-acf96a4c-986b-4fff-8a62-a0aa04365a47 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00011 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:28.637347 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-acf96a4c-986b-4fff-8a62-a0aa04365a47 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00012 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:28.657730 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-acf96a4c-986b-4fff-8a62-a0aa04365a47 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00013 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:28.677075 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-acf96a4c-986b-4fff-8a62-a0aa04365a47 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00014 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:28.701083 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-acf96a4c-986b-4fff-8a62-a0aa04365a47 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00015 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:28.720877 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-acf96a4c-986b-4fff-8a62-a0aa04365a47 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00016 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:28.745588 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-acf96a4c-986b-4fff-8a62-a0aa04365a47 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00017 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:28.764202 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-acf96a4c-986b-4fff-8a62-a0aa04365a47 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00018 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:28.780126 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-acf96a4c-986b-4fff-8a62-a0aa04365a47 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00019 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:28.797067 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-acf96a4c-986b-4fff-8a62-a0aa04365a47 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00020 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:28.815553 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-acf96a4c-986b-4fff-8a62-a0aa04365a47 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4-00021 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:28.835670 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-acf96a4c-986b-4fff-8a62-a0aa04365a47 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4_metadata in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:28.868878 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-acf96a4c-986b-4fff-8a62-a0aa04365a47 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_b7c69ff4-5f13-4c93-a76e-696866e48fb6/20260705035013/az_nova_backup_15d5838c-ec5a-4b52-97f2-82396ddfc2f4_sha256file in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:28.869112 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-acf96a4c-986b-4fff-8a62-a0aa04365a47 tempest-ProjectReaderTests33-1605075867 None] delete 15d5838c-ec5a-4b52-97f2-82396ddfc2f4 finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:50:28.888660 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-acf96a4c-986b-4fff-8a62-a0aa04365a47 tempest-ProjectReaderTests33-1605075867 None] Created reservations ['7709f0ec-852f-481b-8c5f-b508cceeb4b0', '8d4e2e83-2380-44c9-b1e4-efaf0cc19d7c'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:50:28.909834 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-acf96a4c-986b-4fff-8a62-a0aa04365a47 tempest-ProjectReaderTests33-1605075867 None] Delete backup finished, backup 15d5838c-ec5a-4b52-97f2-82396ddfc2f4 deleted. Jul 05 03:50:28.964539 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:28.965297 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 65536 bytes of data to 427 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:28.965435 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:28.985913 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00107: 248253febdf9716b76bb6fba67c523dc {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:28.986041 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:29.408478 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-5ac3d0a4-c31a-493f-8bed-3a12cf4fb984 tempest-ProjectReaderTests33-1605075867 None] Delete backup started, backup: 26336c38-50b4-4658-a99a-2c764d3fabee. Jul 05 03:50:29.412038 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-5ac3d0a4-c31a-493f-8bed-3a12cf4fb984 tempest-ProjectReaderTests33-1605075867 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_d87c99eeab2f4b1da9cfddf03f0cb8b9 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:50:29.412245 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-5ac3d0a4-c31a-493f-8bed-3a12cf4fb984 tempest-ProjectReaderTests33-1605075867 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:50:29.412676 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ac3d0a4-c31a-493f-8bed-3a12cf4fb984 tempest-ProjectReaderTests33-1605075867 None] delete started, backup: 26336c38-50b4-4658-a99a-2c764d3fabee, container: volumebackups, prefix: volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:50:29.461160 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ac3d0a4-c31a-493f-8bed-3a12cf4fb984 tempest-ProjectReaderTests33-1605075867 None] generated object list: ['volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00001', 'volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00002', 'volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00003', 'volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00004', 'volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00005', 'volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00006', 'volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00007', 'volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00008', 'volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00009', 'volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00010', 'volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00011', 'volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00012', 'volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00013', 'volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00014', 'volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00015', 'volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00016', 'volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00017', 'volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00018', 'volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00019', 'volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00020', 'volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00021', 'volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee_metadata', 'volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:50:29.487919 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ac3d0a4-c31a-493f-8bed-3a12cf4fb984 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00001 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:29.510806 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ac3d0a4-c31a-493f-8bed-3a12cf4fb984 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00002 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:29.527568 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:29.528158 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 32768 bytes of data to 68 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:29.528644 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:29.531919 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ac3d0a4-c31a-493f-8bed-3a12cf4fb984 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00003 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:29.552547 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00108: 0ac8838eee7696114147d95e0878e3b2 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:29.552547 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:29.582962 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ac3d0a4-c31a-493f-8bed-3a12cf4fb984 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00004 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:29.591913 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:50:29.602512 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ac3d0a4-c31a-493f-8bed-3a12cf4fb984 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00005 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:29.622662 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ac3d0a4-c31a-493f-8bed-3a12cf4fb984 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00006 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:29.644155 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ac3d0a4-c31a-493f-8bed-3a12cf4fb984 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00007 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:29.665984 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ac3d0a4-c31a-493f-8bed-3a12cf4fb984 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00008 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:29.685722 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ac3d0a4-c31a-493f-8bed-3a12cf4fb984 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00009 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:29.709053 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ac3d0a4-c31a-493f-8bed-3a12cf4fb984 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00010 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:29.729311 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ac3d0a4-c31a-493f-8bed-3a12cf4fb984 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00011 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:29.750937 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ac3d0a4-c31a-493f-8bed-3a12cf4fb984 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00012 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:29.770200 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ac3d0a4-c31a-493f-8bed-3a12cf4fb984 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00013 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:29.790180 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ac3d0a4-c31a-493f-8bed-3a12cf4fb984 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00014 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:29.817374 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ac3d0a4-c31a-493f-8bed-3a12cf4fb984 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00015 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:29.838256 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ac3d0a4-c31a-493f-8bed-3a12cf4fb984 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00016 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:29.857075 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ac3d0a4-c31a-493f-8bed-3a12cf4fb984 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00017 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:29.875044 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ac3d0a4-c31a-493f-8bed-3a12cf4fb984 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00018 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:29.893932 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ac3d0a4-c31a-493f-8bed-3a12cf4fb984 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00019 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:29.914637 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ac3d0a4-c31a-493f-8bed-3a12cf4fb984 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00020 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:29.940267 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ac3d0a4-c31a-493f-8bed-3a12cf4fb984 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee-00021 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:29.962936 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ac3d0a4-c31a-493f-8bed-3a12cf4fb984 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee_metadata in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:29.980209 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ac3d0a4-c31a-493f-8bed-3a12cf4fb984 tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_7459619f-bc7a-456c-9d26-150e36f69279/20260705034954/az_nova_backup_26336c38-50b4-4658-a99a-2c764d3fabee_sha256file in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:29.980456 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ac3d0a4-c31a-493f-8bed-3a12cf4fb984 tempest-ProjectReaderTests33-1605075867 None] delete 26336c38-50b4-4658-a99a-2c764d3fabee finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:50:30.020945 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-5ac3d0a4-c31a-493f-8bed-3a12cf4fb984 tempest-ProjectReaderTests33-1605075867 None] Created reservations ['bfe22f6f-f9c1-4354-8224-f3bba375a116', 'f8fd79d5-09e3-475c-a6bf-f96c8cd97e94'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:50:30.037598 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-5ac3d0a4-c31a-493f-8bed-3a12cf4fb984 tempest-ProjectReaderTests33-1605075867 None] Delete backup finished, backup 26336c38-50b4-4658-a99a-2c764d3fabee deleted. Jul 05 03:50:30.187187 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:30.187937 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 65536 bytes of data to 439 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:30.188069 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:30.211334 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00109: 035e687823ab7e3942cf6921e5f0f13c {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:30.211508 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:30.468509 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-f075238f-6dab-4e03-816b-42b338dbb28f tempest-ProjectReaderTests33-1605075867 None] Delete backup started, backup: 0fb098e1-7ce9-4b97-ae94-e28560a3009d. Jul 05 03:50:30.474069 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-f075238f-6dab-4e03-816b-42b338dbb28f tempest-ProjectReaderTests33-1605075867 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_d87c99eeab2f4b1da9cfddf03f0cb8b9 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:50:30.474336 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-f075238f-6dab-4e03-816b-42b338dbb28f tempest-ProjectReaderTests33-1605075867 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:50:30.474762 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f075238f-6dab-4e03-816b-42b338dbb28f tempest-ProjectReaderTests33-1605075867 None] delete started, backup: 0fb098e1-7ce9-4b97-ae94-e28560a3009d, container: volumebackups, prefix: volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:50:30.484927 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:30.485762 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Compressed 32768 bytes of data to 258 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:30.485911 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:30.509400 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00110: ccd615116dcb4026c3f50f53f219fe04 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:30.509558 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:30.536162 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f075238f-6dab-4e03-816b-42b338dbb28f tempest-ProjectReaderTests33-1605075867 None] generated object list: ['volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00001', 'volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00002', 'volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00003', 'volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00004', 'volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00005', 'volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00006', 'volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00007', 'volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00008', 'volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00009', 'volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00010', 'volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00011', 'volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00012', 'volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00013', 'volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00014', 'volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00015', 'volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00016', 'volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00017', 'volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00018', 'volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00019', 'volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00020', 'volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00021', 'volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d_metadata', 'volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:50:30.544844 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:50:30.550829 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:50:30.556484 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f075238f-6dab-4e03-816b-42b338dbb28f tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00001 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:30.559380 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:50:30.559553 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:50:30.564694 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:50:30.564869 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:50:30.568103 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Completed fetching metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:145}} Jul 05 03:50:30.568472 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:50:30.585514 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f075238f-6dab-4e03-816b-42b338dbb28f tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00002 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:30.609480 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f075238f-6dab-4e03-816b-42b338dbb28f tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00003 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:30.628897 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f075238f-6dab-4e03-816b-42b338dbb28f tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00004 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:30.631914 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:50:30.632727 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] _write_metadata started, container name: volumebackups, metadata filename: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:50:30.654274 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f075238f-6dab-4e03-816b-42b338dbb28f tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00005 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:30.661649 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "b278a846-a6ff-4fc6-9cae-dd99d2be1fd1",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1661982877",\n "created_at": "2026-07-05 03:50:19+00:00",\n "objects": [\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00001": {\n "compression": "zlib",\n "length": 32768,\n "md5": "7455b0146d203e0450dd14035351df50",\n "offset": 0\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00002": {\n "compression": "zlib",\n "length": 294912,\n "md5": "fe5da92e67dfd4c9a34ca9f93fe80fcc",\n "offset": 9437184\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00003": {\n "compression": "zlib",\n "length": 2228224,\n "md5": "215382887039953a4711d9a726d308f7",\n "offset": 16023552\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00004": {\n "compression": "zlib",\n "length": 98304,\n "md5": "e1554f9208060479cb8c0e2b20ce3092",\n "offset": 20283392\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00005": {\n "compression": "zlib",\n "length": 360448,\n "md5": "260e04b2b4be4a8fb9af5bcaeef77f5e",\n "offset": 20414464\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00006": {\n "compression": "zlib",\n "length": 262144,\n "md5": "7e4882497657c646c554c5ad835c0cf5",\n "offset": 20840448\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00007": {\n "compression": "zlib",\n "length": 32768,\n "md5": "d9cd9a4fb7c178bffad872b9fd1c6616",\n "offset": 21364736\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00008": {\n "compression": "zlib",\n "length": 524288,\n "md5": "89771b482f431367ab05882b853a01a6",\n "offset": 21528576\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00009": {\n "compression": "zlib",\n "length": 98304,\n "md5": "807f8f1c74646a8f9592027f16d2643d",\n "offset": 22085632\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00010": {\n "compression": "zlib",\n "length": 65536,\n "md5": "035de9616151b09d26063aaf3786be98",\n "offset": 22282240\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00011": {\n "compression": "zlib",\n "length": 327680,\n "md5": "f941eba3270410ec15b7aff819b8b0c0",\n "offset": 22478848\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00012": {\n "compression": "zlib",\n "length": 327680,\n "md5": "ba683c210943a225502816568e3b8d00",\n "offset": 22872064\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00013": {\n "compression": "zlib",\n "length": 65536,\n "md5": "e88548713f69de90eef0cd6c4e9796dd",\n "offset": 23265280\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00014": {\n "compression": "zlib",\n "length": 393216,\n "md5": "01e3e2d3510c4223690a6849e71496ab",\n "offset": 23396352\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00015": {\n "compression": "zlib",\n "length": 131072,\n "md5": "599805a91aa71f961c3787a61e7c5729",\n "offset": 23855104\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00016": {\n "compression": "zlib",\n "length": 65536,\n "md5": "179b961161bdaa477c7c01ad80585eee",\n "offset": 24051712\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00017": {\n "compression": "zlib",\n "length": 131072,\n "md5": "d27aa048e7ec9b4cbc6afc435ead70f6",\n "offset": 24510464\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00018": {\n "compression": "zlib",\n "length": 786432,\n "md5": "93a49a74b3f385db27466765f9e213d9",\n "offset": 24707072\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00019": {\n "compression": "zlib",\n "length": 65536,\n "md5": "fb0b4c9f443eae7a19740e071a10002c",\n "offset": 25624576\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00020": {\n "compression": "zlib",\n "length": 2293760,\n "md5": "fc804896bdfc39ce809d6d5f4c3d9ec0",\n "offset": 26214400\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00021": {\n "compression": "zlib",\n "length": 262144,\n "md5": "600a0ec270d9626014f041f394a91dec",\n "offset": 28606464\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00022": {\n "compression": "zlib",\n "length": 65536,\n "md5": "d74672ad69032d6511c7f86b7b0cdb23",\n "offset": 29032448\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00023": {\n "compression": "zlib",\n "length": 98304,\n "md5": "b26d859ed07de20dd16d0c165a4e6a3a",\n "offset": 29425664\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00024": {\n "compression": "zlib",\n "length": 294912,\n "md5": "17812a659c805b2d08ad0ffbac17f523",\n "offset": 29622272\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00025": {\n "compression": "zlib",\n "length": 65536,\n "md5": "900ba3be5febaa4a7e8d4fe06a9e5bbe",\n "offset": 30081024\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00026": {\n "compression": "zlib",\n "length": 32768,\n "md5": "7b83ad270600f54dc0ce5f973398f4a1",\n "offset": 30212096\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00027": {\n "compression": "zlib",\n "length": 32768,\n "md5": "a31179c9f17d2086e474bbff2d8b9fa5",\n "offset": 30343168\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00028": {\n "compression": "zlib",\n "length": 98304,\n "md5": "86d6719d73ca0214c25634aedc7fe9d9",\n "offset": 32636928\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00029": {\n "compression": "zlib",\n "length": 98304,\n "md5": "fdf44fcafc023cb46fe41182b8e073b8",\n "offset": 32833536\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00030": {\n "compression": "zlib",\n "length": 524288,\n "md5": "5815c96da9bc9be47f2dde7f69ddd130",\n "offset": 33030144\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00031": {\n "compression": "zlib",\n "length": 131072,\n "md5": "7ecd5b62ea9a77dd27d5058cc0b2af3a",\n "offset": 33619968\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00032": {\n "compression": "zlib",\n "length": 294912,\n "md5": "185eea5b60ee84638ea2ef67b051e400",\n "offset": 33849344\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00033": {\n "compression": "zlib",\n "length": 32768,\n "md5": "e41a77e44d240ad8104d5fb9712151e4",\n "offset": 34275328\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00034": {\n "compression": "zlib",\n "length": 65536,\n "md5": "a7a0eee90ff873fe50f294cf33e7de2d",\n "offset": 34406400\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00035": {\n "compression": "zlib",\n "length": 65536,\n "md5": "5a96fd0be63a553958c90d4a4316c4de",\n "offset": 34537472\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00036": {\n "compression": "zlib",\n "length": 98304,\n "md5": "b02b4173598f30151430937bc55a6faf",\n "offset": 38797312\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00037": {\n "compression": "zlib",\n "length": 262144,\n "md5": "b7e2d07e021e740544325541d67b7329",\n "offset": 38928384\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00038": {\n "compression": "zlib",\n "length": 32768,\n "md5": "00fb2cc13328ca425a2eca1e6c7c4e6d",\n "offset": 39256064\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00039": {\n "compression": "zlib",\n "length": 32768,\n "md5": "d11036511ad7f5dbe776a742c58f87ea",\n "offset": 40370176\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00040": {\n "compression": "zlib",\n "length": 32768,\n "md5": "c4ed5bf65e3847ac3a3103aeb9f043f9",\n "offset": 40566784\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00041": {\n "compression": "zlib",\n "length": 32768,\n "md5": "2abba25a77ee36c58131400ef11e9b33",\n "offset": 40697856\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00042": {\n "compression": "zlib",\n "length": 65536,\n "md5": "58c33934aea3dc04d999003f5971d3e1",\n "offset": 40828928\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00043": {\n "compression": "zlib",\n "length": 65536,\n "md5": "90971d6560092661366d4a8e0d690316",\n "offset": 46399488\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00044": {\n "compression": "zlib",\n "length": 32768,\n "md5": "6d63cabe5cbd45d0e7748b702fb3237f",\n "offset": 46596096\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00045": {\n "compression": "zlib",\n "length": 229376,\n "md5": "b63363b73e33269b13a4b9007772caea",\n "offset": 52199424\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00046": {\n "compression": "zlib",\n "length": 32768,\n "md5": "7ad27b3399ebe8e17313a1edd45d2a4c",\n "offset": 52428800\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00047": {\n "compression": "zlib",\n "length": 65536,\n "md5": "b2f4bed0ea8034625ddd32034addd197",\n "offset": 52494336\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00048": {\n "compression": "zlib",\n "length": 65536,\n "md5": "e2ae44a38272f3786b389fe25de025f7",\n "offset": 52592640\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00049": {\n "compression": "zlib",\n "length": 131072,\n "md5": "459edd959d71fc76632140b2c1c2afd7",\n "offset": 52756480\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00050": {\n "compression": "zlib",\n "length": 262144,\n "md5": "9f03bd9a5f1f3681ce923853068a5391",\n "offset": 52953088\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00051": {\n "compression": "zlib",\n "length": 32768,\n "md5": "808b8e5ae0ebfa3ebee1f25e56d7380e",\n "offset": 53280768\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00052": {\n "compression": "zlib",\n "length": 2162688,\n "md5": "039e5ca2ac2a85e1f145dd61e3971db7",\n "offset": 53411840\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00053": {\n "compression": "zlib",\n "length": 131072,\n "md5": "ac2c3b7f365746cfcedfa3644641f133",\n "offset": 55640064\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00054": {\n "compression": "zlib",\n "length": 262144,\n "md5": "d4e16afa8ee08db846e947df5b4ec08b",\n "offset": 55869440\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00055": {\n "compression": "zlib",\n "length": 196608,\n "md5": "86d6f3eb5f3f66b3bd977ec8c039a49c",\n "offset": 56295424\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00056": {\n "compression": "zlib",\n "length": 196608,\n "md5": "933534e51561c890b382aa9eb4c5764c",\n "offset": 56557568\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00057": {\n "compression": "zlib",\n "length": 32768,\n "md5": "0f7cdc5b89fbb7316ab86f111715879e",\n "offset": 56819712\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00058": {\n "compression": "zlib",\n "length": 65536,\n "md5": "b3534e7bd21436d93d6e15ceae51ecbb",\n "offset": 56950784\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00059": {\n "compression": "zlib",\n "length": 65536,\n "md5": "308e5172c7191c405029e68eb339b63e",\n "offset": 57081856\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00060": {\n "compression": "zlib",\n "length": 98304,\n "md5": "87fed698449bb429c84cea142b47074f",\n "offset": 57212928\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00061": {\n "compression": "zlib",\n "length": 32768,\n "md5": "8577057e39906809834d6bbe62984d84",\n "offset": 57475072\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00062": {\n "compression": "zlib",\n "length": 2162688,\n "md5": "286f32389d41ccb3a7454011b7fe833b",\n "offset": 57606144\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00063": {\n "compression": "zlib",\n "length": 131072,\n "md5": "07f83a91f2a65593c97ccde75e2cdb1a",\n "offset": 59834368\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00064": {\n "compression": "zlib",\n "length": 32768,\n "md5": "472694eb9fd935b65a675e05db84ae55",\n "offset": 60030976\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00065": {\n "compression": "zlib",\n "length": 163840,\n "md5": "7bbd91225a7ad728f1ee251495d662a3",\n "offset": 60227584\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00066": {\n "compression": "zlib",\n "length": 196608,\n "md5": "9c2c443a510acae20e828ca784ea0ef0",\n "offset": 60489728\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00067": {\n "compression": "zlib",\n "length": 32768,\n "md5": "f15596026d78fb5a6c33e31e645c1bc0",\n "offset": 60751872\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00068": {\n "compression": "zlib",\n "length": 131072,\n "md5": "01e07b6ff49d49600cff2b5f037b5585",\n "offset": 60882944\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00069": {\n "compression": "zlib",\n "length": 196608,\n "md5": "2cc1e5bb8b0f7f6b8f396071b242c82d",\n "offset": 61145088\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00070": {\n "compression": "zlib",\n "length": 2555904,\n "md5": "77a339075c2c22a3b220b8be3eafd00a",\n "offset": 61407232\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00071": {\n "compression": "zlib",\n "length": 196608,\n "md5": "4976e1dea54e67ed34a48147acf51f95",\n "offset": 64028672\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00072": {\n "compression": "zlib",\n "length": 32768,\n "md5": "c5102cf8b89d0646b4a8454aa2eb455b",\n "offset": 64290816\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00073": {\n "compression": "zlib",\n "length": 262144,\n "md5": "a90b39452df564cdaee1875cdf14648d",\n "offset": 64356352\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00074": {\n "compression": "zlib",\n "length": 196608,\n "md5": "93190166bf0c7415bc69f707aeecba3d",\n "offset": 64684032\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00075": {\n "compression": "zlib",\n "length": 753664,\n "md5": "f20b7ef7942c255d34567ef7a8c931d5",\n "offset": 64946176\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00076": {\n "compression": "zlib",\n "length": 1245184,\n "md5": "2fec27600c3cba1475524f3a83a147d9",\n "offset": 65863680\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00077": {\n "compression": "zlib",\n "length": 229376,\n "md5": "bd18e2aa13a8966c7ccaeb4a8d2ad111",\n "offset": 67174400\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00078": {\n "compression": "zlib",\n "length": 196608,\n "md5": "2742a11d6ef6f40794ba3a77fdd91fc1",\n "offset": 67567616\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00079": {\n "compression": "zlib",\n "length": 753664,\n "md5": "937919e06f1ac884e907b3b44f7aa3f7",\n "offset": 67829760\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00080": {\n "compression": "zlib",\n "length": 32768,\n "md5": "80bf1a781b69ed6d28f051a8c1bace93",\n "offset": 68681728\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00081": {\n "compression": "zlib",\n "length": 98304,\n "md5": "839ea305330c068b1e25e10bbe0072eb",\n "offset": 68878336\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00082": {\n "compression": "zlib",\n "length": 196608,\n "md5": "e35f12e70225bea64f1d64820a8c34af",\n "offset": 69140480\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00083": {\n "compression": "zlib",\n "length": 32768,\n "md5": "b64ba69a7c7b92cbb6e034a227c535e1",\n "offset": 69402624\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00084": {\n "compression": "zlib",\n "length": 163840,\n "md5": "7271b184b3a0862c0307275252dd4c26",\n "offset": 69468160\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00085": {\n "compression": "zlib",\n "length": 196608,\n "md5": "534ab1b26cf91adf3fcf3f10f1b565b6",\n "offset": 69795840\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00086": {\n "compression": "zlib",\n "length": 524288,\n "md5": "c51969b17b173a09b0699f6aebe1dcd1",\n "offset": 70254592\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00087": {\n "compression": "zlib",\n "length": 98304,\n "md5": "d2e25d026c0032ef44bfe4b5a3ee7400",\n "offset": 71041024\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00088": {\n "compression": "zlib",\n "length": 32768,\n "md5": "91fa160b3091d130dcb1f7c58f5f6e5a",\n "offset": 71172096\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00089": {\n "compression": "zlib",\n "length": 262144,\n "md5": "a77c3df81950fe3ec6756b32c47d5889",\n "offset": 72417280\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00090": {\n "compression": "zlib",\n "length": 65536,\n "md5": "c15a2e2eb7fb41df1e140bbf87c78a9c",\n "offset": 110100480\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00091": {\n "compression": "zlib",\n "length": 196608,\n "md5": "d2f8fd157e57c49a2e7fbb7db668bdfa",\n "offset": 110297088\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00092": {\n "compression": "zlib",\n "length": 65536,\n "md5": "ab4c3c6565d120e31d0ec092b1f40fc0",\n "offset": 110559232\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00093": {\n "compression": "zlib",\n "length": 32768,\n "md5": "6df3fb11329fda670b6a648b803a75c3",\n "offset": 110690304\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00094": {\n "compression": "zlib",\n "length": 32768,\n "md5": "d3338725ce0b00d0d0a20c3dc76363b5",\n "offset": 110821376\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00095": {\n "compression": "zlib",\n "length": 557056,\n "md5": "736df86bae8f6a9fbe7631cf877d988c",\n "offset": 110952448\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00096": {\n "compression": "zlib",\n "length": 131072,\n "md5": "5465c211d4134a5c770e5e96d9420f8b",\n "offset": 111607808\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00097": {\n "compression": "zlib",\n "length": 32768,\n "md5": "125fb29df3a88ed91bb536861e7d1ff9",\n "offset": 111869952\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00098": {\n "compression": "zlib",\n "length": 98304,\n "md5": "38a20f8b3afb8be4ea4deab5f9b3d080",\n "offset": 112001024\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00099": {\n "compression": "zlib",\n "length": 131072,\n "md5": "f87eeae8e3222a88fc335a905cc595f5",\n "offset": 112197632\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00100": {\n "compression": "zlib",\n "length": 131072,\n "md5": "a34ec244a0a06a62255379762d3da663",\n "offset": 112590848\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00101": {\n "compression": "zlib",\n "length": 393216,\n "md5": "ce40a8df09b1374e7997af78065811c8",\n "offset": 113770496\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00102": {\n "compression": "zlib",\n "length": 32768,\n "md5": "5649b75a126d07b66d0cec64e48b81cf",\n "offset": 114229248\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00103": {\n "compression": "zlib",\n "length": 65536,\n "md5": "7f6e95afedd64afe9d241549e3659811",\n "offset": 143654912\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00104": {\n "compression": "zlib",\n "length": 32768,\n "md5": "0ac8838eee7696114147d95e0878e3b2",\n "offset": 277872640\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00105": {\n "compression": "zlib",\n "length": 65536,\n "md5": "727482d1b4dc9faeb4c7861fcce524bc",\n "offset": 412090368\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00106": {\n "compression": "zlib",\n "length": 32768,\n "md5": "0ac8838eee7696114147d95e0878e3b2",\n "offset": 546308096\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00107": {\n "compression": "zlib",\n "length": 65536,\n "md5": "248253febdf9716b76bb6fba67c523dc",\n "offset": 680525824\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00108": {\n "compression": "zlib",\n "length": 32768,\n "md5": "0ac8838eee7696114147d95e0878e3b2",\n "offset": 814743552\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00109": {\n "compression": "zlib",\n "length": 65536,\n "md5": "035e687823ab7e3942cf6921e5f0f13c",\n "offset": 948961280\n }\n },\n {\n "volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00110": {\n "compression": "zlib",\n "length": 32768,\n "md5": "ccd615116dcb4026c3f50f53f219fe04",\n "offset": 1073709056\n }\n }\n ],\n "parent_id": "43a13ec7-8bb2-4118-96f0-671b8f175e1f",\n "version": "1.0.0",\n "volume_id": "b5113927-f7d6-4561-bd3f-c758db6d8325",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"b5113927-f7d6-4561-bd3f-c758db6d8325\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"ea1163b57d574d8c9031fe9c82c96b2c\\", \\"project_id\\": \\"2ee62c33d51844a9a90e9a9e640d703b\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:48:56.000000\\", \\"launched_at\\": \\"2026-07-05T03:48:56.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-697546179\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": true, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:48:55.000000\\", \\"updated_at\\": \\"2026-07-05T03:50:19.000000\\"}, \\"volume-glance-metadata\\": {\\"hw_rng_model\\": \\"virtio\\", \\"os_glance_failed_import\\": \\"\\", \\"os_glance_importing_to_stores\\": \\"\\", \\"owner_specified.openstack.md5\\": \\"\\", \\"owner_specified.openstack.object\\": \\"images/cirros-0.6.3-x86_64-disk\\", \\"owner_specified.openstack.sha256\\": \\"\\", \\"image_id\\": \\"0c8fa207-3de5-4489-a2c5-f4cc8559edb8\\", \\"image_name\\": \\"cirros-0.6.3-x86_64-disk\\", \\"checksum\\": \\"87617e24a5e30cb3b87fda8c0764838f\\", \\"container_format\\": \\"bare\\", \\"disk_format\\": \\"qcow2\\", \\"min_disk\\": \\"0\\", \\"min_ram\\": \\"0\\", \\"size\\": \\"21692416\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:50:30.666747 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] backup b278a846-a6ff-4fc6-9cae-dd99d2be1fd1 finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:50:30.668753 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:50:30.679302 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f075238f-6dab-4e03-816b-42b338dbb28f tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00006 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:30.686621 np0000004562 sudo[156461]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 05 03:50:30.687275 np0000004562 sudo[156461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:50:30.700521 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f075238f-6dab-4e03-816b-42b338dbb28f tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00007 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:30.718211 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f075238f-6dab-4e03-816b-42b338dbb28f tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00008 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:30.735537 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f075238f-6dab-4e03-816b-42b338dbb28f tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00009 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:30.753251 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f075238f-6dab-4e03-816b-42b338dbb28f tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00010 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:30.771541 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f075238f-6dab-4e03-816b-42b338dbb28f tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00011 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:30.787802 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f075238f-6dab-4e03-816b-42b338dbb28f tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00012 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:30.803405 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f075238f-6dab-4e03-816b-42b338dbb28f tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00013 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:30.821074 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f075238f-6dab-4e03-816b-42b338dbb28f tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00014 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:30.837390 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f075238f-6dab-4e03-816b-42b338dbb28f tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00015 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:30.856605 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f075238f-6dab-4e03-816b-42b338dbb28f tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00016 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:30.873699 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f075238f-6dab-4e03-816b-42b338dbb28f tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00017 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:30.891567 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f075238f-6dab-4e03-816b-42b338dbb28f tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00018 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:30.908125 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f075238f-6dab-4e03-816b-42b338dbb28f tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00019 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:30.925490 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f075238f-6dab-4e03-816b-42b338dbb28f tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00020 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:30.943765 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f075238f-6dab-4e03-816b-42b338dbb28f tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d-00021 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:30.961364 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f075238f-6dab-4e03-816b-42b338dbb28f tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d_metadata in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:30.980493 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f075238f-6dab-4e03-816b-42b338dbb28f tempest-ProjectReaderTests33-1605075867 None] deleted object: volume_349583ee-2c02-4c07-a6a5-82a2b9ee11fb/20260705034937/az_nova_backup_0fb098e1-7ce9-4b97-ae94-e28560a3009d_sha256file in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:30.980770 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f075238f-6dab-4e03-816b-42b338dbb28f tempest-ProjectReaderTests33-1605075867 None] delete 0fb098e1-7ce9-4b97-ae94-e28560a3009d finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:50:30.997148 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-f075238f-6dab-4e03-816b-42b338dbb28f tempest-ProjectReaderTests33-1605075867 None] Created reservations ['dba1fb27-92b2-4c80-b810-160153b3e0d9', 'fdc39af2-21c7-41b0-baef-c5a2a9c4fc76'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:50:31.001287 np0000004562 sudo[156461]: pam_unix(sudo:session): session closed for user root Jul 05 03:50:31.002747 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.335s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:50:31.003218 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5113927-f7d6-4561-bd3f-c758db6d8325', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '33000000016d0b1f8', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:50:31.003391 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:50:31.013301 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-f075238f-6dab-4e03-816b-42b338dbb28f tempest-ProjectReaderTests33-1605075867 None] Delete backup finished, backup 0fb098e1-7ce9-4b97-ae94-e28560a3009d deleted. Jul 05 03:50:31.367029 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.363s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:50:31.367328 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5113927-f7d6-4561-bd3f-c758db6d8325', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:50:31.380370 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:50:31.380370 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:50:31.380370 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:50:31.380370 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:50:31.380370 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:50:31.380370 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 Jul 05 03:50:31.380370 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:50:31.380370 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:50:31.380370 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 Jul 05 03:50:31.380370 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:50:31.380370 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:50:31.380370 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:50:31.380370 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:50:31.380370 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:50:31.380370 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:50:31.380370 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:50:31.380751 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:50:31.380751 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:50:31.380751 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:50:31.380751 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:50:31.404649 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('-m', 'session'): stdout=tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:50:31.404649 np0000004562 cinder-backup[101413]: tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:50:31.404649 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:50:31.404649 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:50:31.404874 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] iscsi session list stdout=tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325 (non-flash) Jul 05 03:50:31.404874 np0000004562 cinder-backup[101413]: tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:50:31.404874 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:50:31.404874 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:50:31.405055 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325', '231'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8', '232'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8', '233')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:50:31.405193 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325', '231')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:50:31.406046 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Resulting device map defaultdict(. at 0x72a46fd2a340>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325'): ({'sdb'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:50:31.406284 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Removing multipathed devices sdb {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:50:31.406542 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Flush multipath device 33000000016d0b1f8 {{(pid=101413) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 05 03:50:31.590938 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Flushing IO for device /dev/sdb {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:50:31.598969 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:50:31.653070 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:50:31.653227 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:50:31.654196 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:50:31.663942 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:50:31.664306 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:50:31.674540 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:50:31.704704 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 231, target: iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325, portal: 192.168.40.100,3260] Jul 05 03:50:31.704704 np0000004562 cinder-backup[101413]: Logout of [sid: 231, target: iqn.2023-03.storpool.com:os--volume-b5113927-f7d6-4561-bd3f-c758db6d8325, portal: 192.168.40.100,3260] successful. Jul 05 03:50:31.704704 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:50:31.715185 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:50:31.715524 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:50:31.715754 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] <== disconnect_volume: return (712ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:50:32.740012 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-cd2e38c4-852d-48ab-b4bc-7e01084ddbf0 tempest-VolumesBackupsTest-1375540242 None] Create backup finished. backup: b278a846-a6ff-4fc6-9cae-dd99d2be1fd1. Jul 05 03:50:33.750409 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] Delete backup started, backup: b278a846-a6ff-4fc6-9cae-dd99d2be1fd1. Jul 05 03:50:33.755647 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_2ee62c33d51844a9a90e9a9e640d703b {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:50:33.755647 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:50:33.755647 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] delete started, backup: b278a846-a6ff-4fc6-9cae-dd99d2be1fd1, container: volumebackups, prefix: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:50:33.800402 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] generated object list: ['volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00001', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00002', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00003', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00004', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00005', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00006', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00007', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00008', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00009', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00010', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00011', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00012', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00013', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00014', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00015', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00016', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00017', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00018', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00019', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00020', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00021', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00022', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00023', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00024', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00025', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00026', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00027', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00028', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00029', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00030', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00031', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00032', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00033', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00034', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00035', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00036', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00037', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00038', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00039', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00040', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00041', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00042', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00043', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00044', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00045', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00046', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00047', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00048', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00049', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00050', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00051', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00052', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00053', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00054', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00055', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00056', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00057', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00058', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00059', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00060', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00061', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00062', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00063', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00064', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00065', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00066', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00067', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00068', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00069', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00070', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00071', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00072', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00073', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00074', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00075', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00076', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00077', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00078', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00079', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00080', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00081', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00082', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00083', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00084', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00085', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00086', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00087', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00088', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00089', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00090', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00091', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00092', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00093', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00094', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00095', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00096', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00097', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00098', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00099', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00100', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00101', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00102', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00103', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00104', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00105', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00106', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00107', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00108', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00109', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00110', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1_metadata', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:50:33.819400 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00001 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:33.837453 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00002 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:33.856308 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00003 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:33.874202 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00004 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:33.893559 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00005 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:33.913916 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00006 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:33.930802 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00007 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:33.947873 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00008 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:33.964927 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00009 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:33.982979 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00010 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.001561 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00011 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.019667 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00012 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.036913 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00013 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.055828 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00014 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.076802 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00015 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.096415 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00016 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.116207 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00017 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.135366 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00018 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.155025 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00019 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.174636 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00020 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.195351 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00021 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.214628 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00022 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.232474 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00023 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.249094 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00024 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.266385 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00025 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.282670 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00026 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.299137 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00027 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.317090 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00028 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.334982 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00029 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.350777 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00030 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.366017 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00031 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.381897 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00032 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.398230 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00033 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.415891 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00034 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.434804 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00035 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.452565 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00036 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.470032 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00037 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.487378 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00038 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.506932 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00039 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.526312 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00040 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.544642 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00041 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.563353 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00042 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.583392 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00043 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.603831 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00044 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.621014 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00045 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.636806 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00046 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.652363 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00047 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.671540 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00048 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.689684 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00049 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.706304 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00050 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.723667 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00051 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.741002 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00052 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.758882 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00053 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.779314 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00054 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.796684 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00055 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.813743 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00056 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.830942 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00057 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.848313 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00058 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.866648 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00059 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.884650 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00060 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.901254 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00061 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.918945 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00062 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.938900 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00063 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.959323 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00064 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.978885 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00065 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:34.996344 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00066 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.014985 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00067 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.031017 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00068 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.048042 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00069 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.068919 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00070 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.088328 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00071 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.108763 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00072 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.130869 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00073 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.147034 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00074 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.167252 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00075 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.184237 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00076 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.205612 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00077 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.229608 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00078 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.249654 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00079 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.269360 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00080 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.290727 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00081 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.307575 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00082 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.327340 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00083 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.345547 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00084 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.364531 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00085 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.384511 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00086 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.406120 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00087 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.427567 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00088 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.445075 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00089 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.461485 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00090 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.479821 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00091 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.496243 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00092 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.514055 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00093 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.530108 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00094 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.548162 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00095 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.565474 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00096 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.584079 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00097 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.602940 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00098 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.621205 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00099 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.639809 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00100 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.660814 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00101 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.680226 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00102 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.698601 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00103 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.715933 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00104 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.733518 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00105 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.751448 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00106 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.769563 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00107 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.793444 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00108 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.813477 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00109 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.835822 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1-00110 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.856073 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1_metadata in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.875691 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705035022/az_nova_backup_b278a846-a6ff-4fc6-9cae-dd99d2be1fd1_sha256file in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:35.875974 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] delete b278a846-a6ff-4fc6-9cae-dd99d2be1fd1 finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:50:35.910582 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:50:35.912173 np0000004562 cinder-backup[101413]: DEBUG dbcounter [-] [101413] Writing DB stats cinder:UPDATE=44,cinder:SELECT=148,cinder:INSERT=6 {{(pid=101413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:50:35.924806 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] Created reservations ['3b1201ba-f43e-455e-a489-4a71dca065de', 'c8bfd686-ede8-4566-a413-f7fd9677a252'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:50:35.945271 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-a9069c9d-d7fd-4772-b5bf-49daace5e658 tempest-VolumesBackupsTest-1375540242 None] Delete backup finished, backup b278a846-a6ff-4fc6-9cae-dd99d2be1fd1 deleted. Jul 05 03:50:37.230913 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-57e4ab8b-2197-4cda-b8c9-5156a6c92335 tempest-VolumesBackupsTest-1375540242 None] Delete backup started, backup: 43a13ec7-8bb2-4118-96f0-671b8f175e1f. Jul 05 03:50:37.238205 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-57e4ab8b-2197-4cda-b8c9-5156a6c92335 tempest-VolumesBackupsTest-1375540242 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_2ee62c33d51844a9a90e9a9e640d703b {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:50:37.239044 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-57e4ab8b-2197-4cda-b8c9-5156a6c92335 tempest-VolumesBackupsTest-1375540242 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:50:37.239273 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57e4ab8b-2197-4cda-b8c9-5156a6c92335 tempest-VolumesBackupsTest-1375540242 None] delete started, backup: 43a13ec7-8bb2-4118-96f0-671b8f175e1f, container: volumebackups, prefix: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:50:37.289628 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57e4ab8b-2197-4cda-b8c9-5156a6c92335 tempest-VolumesBackupsTest-1375540242 None] generated object list: ['volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00001', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00002', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00003', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00004', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00005', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00006', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00007', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00008', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00009', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00010', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00011', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00012', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00013', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00014', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00015', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00016', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00017', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00018', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00019', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00020', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00021', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f_metadata', 'volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:50:37.309691 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57e4ab8b-2197-4cda-b8c9-5156a6c92335 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00001 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:37.327753 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57e4ab8b-2197-4cda-b8c9-5156a6c92335 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00002 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:37.346236 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57e4ab8b-2197-4cda-b8c9-5156a6c92335 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00003 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:37.363838 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57e4ab8b-2197-4cda-b8c9-5156a6c92335 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00004 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:37.382654 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57e4ab8b-2197-4cda-b8c9-5156a6c92335 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00005 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:37.400206 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57e4ab8b-2197-4cda-b8c9-5156a6c92335 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00006 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:37.419823 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57e4ab8b-2197-4cda-b8c9-5156a6c92335 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00007 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:37.439003 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57e4ab8b-2197-4cda-b8c9-5156a6c92335 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00008 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:37.457682 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57e4ab8b-2197-4cda-b8c9-5156a6c92335 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00009 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:37.476651 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57e4ab8b-2197-4cda-b8c9-5156a6c92335 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00010 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:37.492991 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57e4ab8b-2197-4cda-b8c9-5156a6c92335 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00011 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:37.511855 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57e4ab8b-2197-4cda-b8c9-5156a6c92335 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00012 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:37.528237 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57e4ab8b-2197-4cda-b8c9-5156a6c92335 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00013 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:37.556498 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57e4ab8b-2197-4cda-b8c9-5156a6c92335 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00014 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:37.576891 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57e4ab8b-2197-4cda-b8c9-5156a6c92335 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00015 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:37.601534 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57e4ab8b-2197-4cda-b8c9-5156a6c92335 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00016 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:37.618851 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57e4ab8b-2197-4cda-b8c9-5156a6c92335 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00017 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:37.639399 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57e4ab8b-2197-4cda-b8c9-5156a6c92335 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00018 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:37.657174 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57e4ab8b-2197-4cda-b8c9-5156a6c92335 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00019 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:37.678246 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57e4ab8b-2197-4cda-b8c9-5156a6c92335 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00020 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:37.697682 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57e4ab8b-2197-4cda-b8c9-5156a6c92335 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f-00021 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:37.718992 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57e4ab8b-2197-4cda-b8c9-5156a6c92335 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f_metadata in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:37.737135 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57e4ab8b-2197-4cda-b8c9-5156a6c92335 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_b5113927-f7d6-4561-bd3f-c758db6d8325/20260705034902/az_nova_backup_43a13ec7-8bb2-4118-96f0-671b8f175e1f_sha256file in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:37.737461 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57e4ab8b-2197-4cda-b8c9-5156a6c92335 tempest-VolumesBackupsTest-1375540242 None] delete 43a13ec7-8bb2-4118-96f0-671b8f175e1f finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:50:37.790899 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-57e4ab8b-2197-4cda-b8c9-5156a6c92335 tempest-VolumesBackupsTest-1375540242 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:50:37.803964 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-57e4ab8b-2197-4cda-b8c9-5156a6c92335 tempest-VolumesBackupsTest-1375540242 None] Created reservations ['1065ec5f-d967-486b-a401-962afa49248a', 'f7ee4988-3ad8-45c4-8888-255e59fe0695'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:50:37.823269 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-57e4ab8b-2197-4cda-b8c9-5156a6c92335 tempest-VolumesBackupsTest-1375540242 None] Delete backup finished, backup 43a13ec7-8bb2-4118-96f0-671b8f175e1f deleted. Jul 05 03:50:40.676027 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Create backup started, backup: 4cba2c84-5636-4994-9af7-7253d05cba1c volume: 97340f45-274c-483c-8f15-38025e663865 snapshot: f6520d41-5f8c-4a0f-9e7e-dad613a6320f. Jul 05 03:50:40.680314 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T03:50:40Z,data_timestamp=2026-07-05T03:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-46249194',encryption_key_id=None,fail_reason=None,host='np0000004562',id=4cba2c84-5636-4994-9af7-7253d05cba1c,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='2ee62c33d51844a9a90e9a9e640d703b',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id='f6520d41-5f8c-4a0f-9e7e-dad613a6320f',status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='ea1163b57d574d8c9031fe9c82c96b2c',volume_id=97340f45-274c-483c-8f15-38025e663865) Jul 05 03:50:40.730785 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_2ee62c33d51844a9a90e9a9e640d703b {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:50:40.731090 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:50:40.731410 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:50:40.740578 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:50:40.758454 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:50:40.770608 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:50:40.770849 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:50:40.779014 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:50:40.779766 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:feba:17f3', 'fe80::e477:baff:fee9:cab5'] Jul 05 03:50:40.779884 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:50:40.780022 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:50:40.780244 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] <== get_connector_properties: return (48ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:50:41.284436 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:50:41.284840 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1a5e4dff-67ba-487d-b633-4924dd36e798', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1a5e4dff-67ba-487d-b633-4924dd36e798', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:50:41.285067 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:50:41.285604 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:50:41.285832 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1a5e4dff-67ba-487d-b633-4924dd36e798', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1a5e4dff-67ba-487d-b633-4924dd36e798', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:50:41.297349 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1a5e4dff-67ba-487d-b633-4924dd36e798" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:50:41.297805 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1a5e4dff-67ba-487d-b633-4924dd36e798" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:50:41.298066 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:50:41.308009 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:50:41.308009 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:50:41.318489 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1a5e4dff-67ba-487d-b633-4924dd36e798] added Jul 05 03:50:41.318489 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:50:41.318489 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:50:41.318489 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:50:41.318489 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:50:41.318489 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:50:41.318489 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:50:41.318689 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:50:41.319129 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.021(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:50:41.319349 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:50:42.320440 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-1a5e4dff-67ba-487d-b633-4924dd36e798 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:50:42.331283 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:50:42.340828 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:50:42.352129 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('-m', 'session'): stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:50:42.352129 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:50:42.352129 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:50:42.352349 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] iscsi session list stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:50:42.352349 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:50:42.352349 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:50:42.378082 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1a5e4dff-67ba-487d-b633-4924dd36e798, portal: 192.168.40.100,3260] Jul 05 03:50:42.378082 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1a5e4dff-67ba-487d-b633-4924dd36e798, portal: 192.168.40.100,3260] successful. Jul 05 03:50:42.378082 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:50:42.388893 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:50:42.400502 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('-m', 'session'): stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:50:42.400502 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:50:42.400502 np0000004562 cinder-backup[101413]: tcp: [234] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a5e4dff-67ba-487d-b633-4924dd36e798 (non-flash) Jul 05 03:50:42.400502 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:50:42.400790 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] iscsi session list stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:50:42.400790 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:50:42.400790 np0000004562 cinder-backup[101413]: tcp: [234] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a5e4dff-67ba-487d-b633-4924dd36e798 (non-flash) Jul 05 03:50:42.400790 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:50:42.400978 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1a5e4dff-67ba-487d-b633-4924dd36e798" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.103s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:50:42.401112 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:50:42.401541 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] HCTL ('7', '-', '-', 0) found on session 234 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:50:42.401666 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:50:42.413899 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Searching for a device in session 234 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:50:42.413899 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1a5e4dff-67ba-487d-b633-4924dd36e798', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1a5e4dff-67ba-487d-b633-4924dd36e798', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:50:43.417373 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.132s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:50:43.417827 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] <== connect_volume: return (2132ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799252', 'path': '/dev/sdb'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:50:43.417827 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:50:43.436027 np0000004562 sudo[156665]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 05 03:50:43.436650 np0000004562 sudo[156665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:50:43.760140 np0000004562 sudo[156665]: pam_unix(sudo:session): session closed for user root Jul 05 03:50:43.762270 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.344s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:50:43.799027 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:50:43.808210 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] _create_container started, container: volumebackups,backup: 4cba2c84-5636-4994-9af7-7253d05cba1c. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:50:43.836750 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] generate_object_name_prefix: volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:50:43.841543 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] starting backup of volume: 97340f45-274c-483c-8f15-38025e663865, volume size: 1073741824, object names prefix volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:50:44.021403 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:44.280291 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:44.280448 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:44.387267 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:44.387465 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:44.589834 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:44.830644 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:44.830826 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:44.931056 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:44.931201 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:45.110215 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:45.346214 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:45.346395 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:45.445386 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:45.445566 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:45.622101 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:45.860018 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:45.860202 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:45.958918 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:45.959091 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:46.136410 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:46.380925 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:46.381066 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:46.477110 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:46.477236 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:46.673878 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:46.912550 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:46.912696 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:47.011887 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:47.012058 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:47.181964 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:47.423098 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:47.423332 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:47.522300 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:47.522474 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:47.738369 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:47.988992 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:47.989116 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:48.088497 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:48.088688 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:48.279237 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:48.551782 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:48.551925 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:48.653022 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:48.653240 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:48.842052 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:49.093207 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:49.093426 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:49.195289 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:49.195510 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:49.430874 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:49.680979 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:49.681223 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:49.781875 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:49.782123 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:49.974643 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:50.228603 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:50.228731 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:50.327549 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:50.328287 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:50.504335 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:50.745062 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:50.745220 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:50.843453 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:50.843645 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:51.028875 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:51.272558 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:51.272827 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:51.373959 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:51.374136 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:51.567992 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:51.816173 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:51.816406 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:51.917631 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:51.917824 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:52.091126 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:52.344060 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:52.344258 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:52.442496 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:52.442685 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:52.622560 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:52.858852 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:52.859049 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:52.955034 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:52.955219 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:53.130868 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:53.372130 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:53.372258 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:53.472033 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:53.472033 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:53.650598 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:53.889665 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:53.889857 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:53.987001 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:53.987242 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:54.187634 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:54.428389 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:54.428636 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:54.527205 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:54.527205 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:54.624759 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:50:54.740346 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:50:54.740516 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:50:54.796215 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] backup MD5 for volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:50:54.796356 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:50:54.803348 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:50:54.808059 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:50:54.808233 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:50:54.811769 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:50:54.811894 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:50:54.814647 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:50:54.814898 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:50:54.865544 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:50:54.866192 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] _write_metadata started, container name: volumebackups, metadata filename: volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:50:54.887453 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "4cba2c84-5636-4994-9af7-7253d05cba1c",\n "backup_name": "tempest-VolumesBackupsTest-Backup-46249194",\n "created_at": "2026-07-05 03:50:41+00:00",\n "objects": [\n {\n "volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "97340f45-274c-483c-8f15-38025e663865",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"97340f45-274c-483c-8f15-38025e663865\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"ea1163b57d574d8c9031fe9c82c96b2c\\", \\"project_id\\": \\"2ee62c33d51844a9a90e9a9e640d703b\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"available\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:50:38.000000\\", \\"launched_at\\": \\"2026-07-05T03:50:39.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-229066152\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": null, \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:50:38.000000\\", \\"updated_at\\": \\"2026-07-05T03:50:39.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:50:54.891814 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] backup 4cba2c84-5636-4994-9af7-7253d05cba1c finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:50:55.014431 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:50:55.035205 np0000004562 sudo[156743]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 05 03:50:55.035801 np0000004562 sudo[156743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:50:55.320527 np0000004562 sudo[156743]: pam_unix(sudo:session): session closed for user root Jul 05 03:50:55.322672 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.308s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:50:55.323397 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1a5e4dff-67ba-487d-b633-4924dd36e798', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1a5e4dff-67ba-487d-b633-4924dd36e798', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799252', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:50:55.323614 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:50:55.324163 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:50:55.324561 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1a5e4dff-67ba-487d-b633-4924dd36e798', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1a5e4dff-67ba-487d-b633-4924dd36e798', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:50:55.337447 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:50:55.337447 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:50:55.337447 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:50:55.337447 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:50:55.337447 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:50:55.337447 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-1a5e4dff-67ba-487d-b633-4924dd36e798 Jul 05 03:50:55.337447 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:50:55.337447 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:50:55.337447 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 Jul 05 03:50:55.337447 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:50:55.337447 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:50:55.337447 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:50:55.337447 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:50:55.337447 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:50:55.337447 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:50:55.337447 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:50:55.337969 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:50:55.337969 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:50:55.337969 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:50:55.338047 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a5e4dff-67ba-487d-b633-4924dd36e798', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:50:55.358243 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('-m', 'session'): stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:50:55.358243 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:50:55.358243 np0000004562 cinder-backup[101413]: tcp: [234] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a5e4dff-67ba-487d-b633-4924dd36e798 (non-flash) Jul 05 03:50:55.358243 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:50:55.358418 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] iscsi session list stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:50:55.358418 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:50:55.358418 np0000004562 cinder-backup[101413]: tcp: [234] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a5e4dff-67ba-487d-b633-4924dd36e798 (non-flash) Jul 05 03:50:55.358418 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:50:55.358575 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8', '232'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8', '233'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a5e4dff-67ba-487d-b633-4924dd36e798', '234')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:50:55.358787 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1a5e4dff-67ba-487d-b633-4924dd36e798, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a5e4dff-67ba-487d-b633-4924dd36e798', '234')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:50:55.359875 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Resulting device map defaultdict(. at 0x72a470545d00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a5e4dff-67ba-487d-b633-4924dd36e798'): ({'sdb'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:50:55.360113 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Removing single pathed devices sdb {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:50:55.371113 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Flushing IO for device /dev/sdb {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:50:55.378763 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:50:55.415118 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:50:55.415397 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:50:55.416437 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:50:55.425765 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:50:55.426076 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a5e4dff-67ba-487d-b633-4924dd36e798')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:50:55.436288 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:50:55.463619 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 234, target: iqn.2023-03.storpool.com:os--volume-1a5e4dff-67ba-487d-b633-4924dd36e798, portal: 192.168.40.100,3260] Jul 05 03:50:55.463619 np0000004562 cinder-backup[101413]: Logout of [sid: 234, target: iqn.2023-03.storpool.com:os--volume-1a5e4dff-67ba-487d-b633-4924dd36e798, portal: 192.168.40.100,3260] successful. Jul 05 03:50:55.463619 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:50:55.474500 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:50:55.474770 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.151s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:50:55.474922 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] <== disconnect_volume: return (151ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:50:56.508551 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-c69879fb-9d70-46ce-84f3-976f115c7c80 tempest-VolumesBackupsTest-1375540242 None] Create backup finished. backup: 4cba2c84-5636-4994-9af7-7253d05cba1c. Jul 05 03:50:57.009722 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-6e160c1d-b497-46e6-868a-82ffff125d06 tempest-VolumesBackupsTest-1375540242 None] Delete backup started, backup: 4cba2c84-5636-4994-9af7-7253d05cba1c. Jul 05 03:50:57.015005 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-6e160c1d-b497-46e6-868a-82ffff125d06 tempest-VolumesBackupsTest-1375540242 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_2ee62c33d51844a9a90e9a9e640d703b {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:50:57.015291 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-6e160c1d-b497-46e6-868a-82ffff125d06 tempest-VolumesBackupsTest-1375540242 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:50:57.015433 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6e160c1d-b497-46e6-868a-82ffff125d06 tempest-VolumesBackupsTest-1375540242 None] delete started, backup: 4cba2c84-5636-4994-9af7-7253d05cba1c, container: volumebackups, prefix: volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:50:57.052265 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6e160c1d-b497-46e6-868a-82ffff125d06 tempest-VolumesBackupsTest-1375540242 None] generated object list: ['volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00001', 'volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00002', 'volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00003', 'volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00004', 'volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00005', 'volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00006', 'volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00007', 'volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00008', 'volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00009', 'volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00010', 'volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00011', 'volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00012', 'volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00013', 'volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00014', 'volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00015', 'volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00016', 'volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00017', 'volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00018', 'volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00019', 'volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00020', 'volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00021', 'volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c_metadata', 'volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:50:57.067266 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6e160c1d-b497-46e6-868a-82ffff125d06 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00001 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:57.082873 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6e160c1d-b497-46e6-868a-82ffff125d06 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00002 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:57.098840 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6e160c1d-b497-46e6-868a-82ffff125d06 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00003 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:57.117138 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6e160c1d-b497-46e6-868a-82ffff125d06 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00004 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:57.136278 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6e160c1d-b497-46e6-868a-82ffff125d06 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00005 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:57.153477 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6e160c1d-b497-46e6-868a-82ffff125d06 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00006 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:57.169349 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6e160c1d-b497-46e6-868a-82ffff125d06 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00007 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:57.185587 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6e160c1d-b497-46e6-868a-82ffff125d06 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00008 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:57.204311 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6e160c1d-b497-46e6-868a-82ffff125d06 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00009 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:57.223167 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6e160c1d-b497-46e6-868a-82ffff125d06 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00010 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:57.241650 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6e160c1d-b497-46e6-868a-82ffff125d06 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00011 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:57.261246 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6e160c1d-b497-46e6-868a-82ffff125d06 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00012 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:57.279121 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6e160c1d-b497-46e6-868a-82ffff125d06 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00013 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:57.298054 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6e160c1d-b497-46e6-868a-82ffff125d06 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00014 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:57.315780 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6e160c1d-b497-46e6-868a-82ffff125d06 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00015 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:57.337979 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6e160c1d-b497-46e6-868a-82ffff125d06 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00016 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:57.359823 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6e160c1d-b497-46e6-868a-82ffff125d06 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00017 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:57.380040 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6e160c1d-b497-46e6-868a-82ffff125d06 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00018 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:57.397531 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6e160c1d-b497-46e6-868a-82ffff125d06 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00019 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:57.414656 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6e160c1d-b497-46e6-868a-82ffff125d06 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00020 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:57.432093 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6e160c1d-b497-46e6-868a-82ffff125d06 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c-00021 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:57.450078 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6e160c1d-b497-46e6-868a-82ffff125d06 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c_metadata in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:57.466445 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6e160c1d-b497-46e6-868a-82ffff125d06 tempest-VolumesBackupsTest-1375540242 None] deleted object: volume_97340f45-274c-483c-8f15-38025e663865/20260705035043/az_nova_backup_4cba2c84-5636-4994-9af7-7253d05cba1c_sha256file in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:50:57.466644 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-6e160c1d-b497-46e6-868a-82ffff125d06 tempest-VolumesBackupsTest-1375540242 None] delete 4cba2c84-5636-4994-9af7-7253d05cba1c finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:50:57.498755 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-6e160c1d-b497-46e6-868a-82ffff125d06 tempest-VolumesBackupsTest-1375540242 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:50:57.511358 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-6e160c1d-b497-46e6-868a-82ffff125d06 tempest-VolumesBackupsTest-1375540242 None] Created reservations ['84b9ff64-ff62-451c-b097-187b240a5ded', '56555200-216a-4327-ba09-bd2ab7e52366'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:50:57.525777 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-6e160c1d-b497-46e6-868a-82ffff125d06 tempest-VolumesBackupsTest-1375540242 None] Delete backup finished, backup 4cba2c84-5636-4994-9af7-7253d05cba1c deleted. Jul 05 03:51:07.524078 np0000004562 cinder-backup[101413]: DEBUG dbcounter [-] [101413] Writing DB stats cinder:SELECT=55,cinder:INSERT=6,cinder:UPDATE=26 {{(pid=101413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:51:07.700446 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Create backup started, backup: eb4dc020-f37d-4f14-b95a-a0e142930233 volume: ed2396ac-df7f-4fb8-b24b-b79d100c0a21. Jul 05 03:51:07.705089 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T03:51:07Z,data_timestamp=2026-07-05T03:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-1741087987',encryption_key_id=None,fail_reason=None,host='np0000004562',id=eb4dc020-f37d-4f14-b95a-a0e142930233,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='9a2e18e6fd724ecabbdcdc1aed9f15d7',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='b80b78941fd448ffbd4d016cc2facc64',volume_id=ed2396ac-df7f-4fb8-b24b-b79d100c0a21) Jul 05 03:51:07.725254 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_9a2e18e6fd724ecabbdcdc1aed9f15d7 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:51:07.725405 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:51:07.725681 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:51:07.737553 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:51:07.757557 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:51:07.768813 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:51:07.769152 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:51:07.777240 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:51:07.778133 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:feba:17f3', 'fe80::e477:baff:fee9:cab5'] Jul 05 03:51:07.778281 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:51:07.778398 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:51:07.778644 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] <== get_connector_properties: return (52ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:51:08.282651 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:51:08.283246 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed2396ac-df7f-4fb8-b24b-b79d100c0a21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:51:08.283447 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:51:08.284006 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:51:08.284255 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed2396ac-df7f-4fb8-b24b-b79d100c0a21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:51:08.295350 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:51:08.295859 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:51:08.296143 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:51:08.306340 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:51:08.306340 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:51:08.316378 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21] added Jul 05 03:51:08.316378 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:51:08.316378 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:51:08.316378 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:51:08.316378 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:51:08.316378 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:51:08.316378 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:51:08.316584 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:51:08.316943 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0207(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:51:08.317134 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:51:09.318259 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:51:09.328497 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:51:09.337638 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:51:09.348445 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('-m', 'session'): stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:09.348445 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:09.348445 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:51:09.348658 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] iscsi session list stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:09.348658 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:09.348658 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:51:09.372964 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21, portal: 192.168.40.100,3260] Jul 05 03:51:09.372964 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21, portal: 192.168.40.100,3260] successful. Jul 05 03:51:09.372964 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:51:09.382678 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:51:09.393600 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('-m', 'session'): stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:09.393600 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:09.393600 np0000004562 cinder-backup[101413]: tcp: [235] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21 (non-flash) Jul 05 03:51:09.393600 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:51:09.393785 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] iscsi session list stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:09.393785 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:09.393785 np0000004562 cinder-backup[101413]: tcp: [235] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21 (non-flash) Jul 05 03:51:09.393785 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:51:09.394109 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.098s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:51:09.394241 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:51:09.394833 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] HCTL ('7', '-', '-', 0) found on session 235 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:51:09.394986 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:51:09.405629 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Searching for a device in session 235 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:51:09.405629 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed2396ac-df7f-4fb8-b24b-b79d100c0a21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:51:10.408486 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.124s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:51:10.408874 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] <== connect_volume: return (2124ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799265', 'path': '/dev/sdb'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:51:10.408991 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:51:10.424669 np0000004562 sudo[156852]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 05 03:51:10.425299 np0000004562 sudo[156852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:51:10.714074 np0000004562 sudo[156852]: pam_unix(sudo:session): session closed for user root Jul 05 03:51:10.716087 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.307s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:51:10.751903 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:51:10.757961 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] _create_container started, container: volumebackups,backup: eb4dc020-f37d-4f14-b95a-a0e142930233. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:51:10.892225 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] generate_object_name_prefix: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233 {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:51:10.896026 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] starting backup of volume: ed2396ac-df7f-4fb8-b24b-b79d100c0a21, volume size: 1073741824, object names prefix volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:51:11.062805 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:11.303356 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:11.303475 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:11.406157 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:11.406157 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:11.589562 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:11.834454 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:11.834618 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:11.934613 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:11.934800 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:12.118074 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:12.373528 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:12.373625 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:12.471903 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:12.472079 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:12.674337 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:12.912996 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:12.913151 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:13.010912 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:13.011083 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:13.187019 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:13.430572 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:13.430723 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:13.528955 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:13.529116 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:13.702577 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:13.941207 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:13.941360 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:14.038083 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:14.038221 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:14.206470 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:14.442942 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:14.443136 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:14.538834 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:14.539027 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:14.716131 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:14.957097 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:14.957216 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:15.052905 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:15.053073 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:15.236000 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:15.475513 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:15.475768 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:15.573535 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:15.573719 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:15.753163 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:15.994361 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:15.994521 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:16.091191 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:16.091386 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:16.282465 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:16.518025 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:16.518220 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:16.615969 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:16.616196 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:16.799950 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:17.047034 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:17.047220 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:17.146242 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:17.146485 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:17.333883 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:17.574199 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:17.574409 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:17.672311 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:17.672560 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:17.859539 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:18.099135 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:18.099302 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:18.196726 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:18.196944 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:18.388689 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:18.637490 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:18.637626 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:18.736418 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:18.736545 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:18.906354 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:19.165838 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:19.165986 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:19.264227 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:19.264366 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:19.443548 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:19.682674 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:19.682891 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:19.780926 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:19.781090 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:19.970888 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:20.209571 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:20.209733 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:20.314516 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:20.314647 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:20.484112 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:20.724076 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:20.724298 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:20.822876 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:20.823028 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:21.001469 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:21.242598 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:21.242775 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:21.344007 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:21.344127 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:21.439191 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:21.554448 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:21.554588 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:21.616959 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:21.617146 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:21.623852 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:51:21.629182 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:51:21.629319 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:51:21.632974 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:51:21.633091 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:51:21.635825 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:51:21.636121 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:51:21.689374 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:51:21.690027 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] _write_metadata started, container name: volumebackups, metadata filename: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:51:21.712542 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "eb4dc020-f37d-4f14-b95a-a0e142930233",\n "backup_name": "tempest-type-Backup-1741087987",\n "created_at": "2026-07-05 03:51:08+00:00",\n "objects": [\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "ed2396ac-df7f-4fb8-b24b-b79d100c0a21",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"ed2396ac-df7f-4fb8-b24b-b79d100c0a21\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"b80b78941fd448ffbd4d016cc2facc64\\", \\"project_id\\": \\"9a2e18e6fd724ecabbdcdc1aed9f15d7\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:51:07.000000\\", \\"launched_at\\": \\"2026-07-05T03:51:07.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-2027233181\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:51:06.000000\\", \\"updated_at\\": \\"2026-07-05T03:51:08.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:51:21.716905 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] backup eb4dc020-f37d-4f14-b95a-a0e142930233 finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:51:21.841306 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:51:21.859292 np0000004562 sudo[156875]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 05 03:51:21.859918 np0000004562 sudo[156875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:51:22.176333 np0000004562 sudo[156875]: pam_unix(sudo:session): session closed for user root Jul 05 03:51:22.178511 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.337s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:51:22.179341 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed2396ac-df7f-4fb8-b24b-b79d100c0a21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799265', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:51:22.179594 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:51:22.180190 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:51:22.180630 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed2396ac-df7f-4fb8-b24b-b79d100c0a21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:51:22.192089 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:51:22.192089 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:51:22.192089 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:51:22.192089 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:51:22.192089 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:51:22.192089 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21 Jul 05 03:51:22.192089 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:51:22.192089 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:51:22.192089 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 Jul 05 03:51:22.192089 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:51:22.192089 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:51:22.192089 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:51:22.192089 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:51:22.192089 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:51:22.192089 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:51:22.192089 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:51:22.192413 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:51:22.192413 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:51:22.192413 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:51:22.192581 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:51:22.217402 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('-m', 'session'): stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:22.217402 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:22.217402 np0000004562 cinder-backup[101413]: tcp: [235] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21 (non-flash) Jul 05 03:51:22.217402 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:51:22.217619 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] iscsi session list stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:22.217619 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:22.217619 np0000004562 cinder-backup[101413]: tcp: [235] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21 (non-flash) Jul 05 03:51:22.217619 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:51:22.217766 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8', '232'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8', '233'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21', '235')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:51:22.218026 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21', '235')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:51:22.218901 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Resulting device map defaultdict(. at 0x72a470568180>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21'): ({'sdb'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:51:22.219124 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Removing single pathed devices sdb {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:51:22.230038 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Flushing IO for device /dev/sdb {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:51:22.237753 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:51:22.278289 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:51:22.278478 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:51:22.279594 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:51:22.288981 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:51:22.289289 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:51:22.299658 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:51:22.324647 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 235, target: iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21, portal: 192.168.40.100,3260] Jul 05 03:51:22.324647 np0000004562 cinder-backup[101413]: Logout of [sid: 235, target: iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21, portal: 192.168.40.100,3260] successful. Jul 05 03:51:22.324647 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:51:22.335511 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:51:22.335869 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.156s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:51:22.336062 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] <== disconnect_volume: return (156ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:51:23.354945 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-1be7d641-49fe-454c-9fb3-9ad789e269e5 tempest-ProjectMemberTests33-1641103150 None] Create backup finished. backup: eb4dc020-f37d-4f14-b95a-a0e142930233. Jul 05 03:51:24.192278 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Create backup started, backup: 5f847480-ddde-44fe-a193-61b33cd86e02 volume: ed2396ac-df7f-4fb8-b24b-b79d100c0a21. Jul 05 03:51:24.197439 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T03:51:24Z,data_timestamp=2026-07-05T03:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='np0000004562',id=5f847480-ddde-44fe-a193-61b33cd86e02,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='9a2e18e6fd724ecabbdcdc1aed9f15d7',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='4c97280990fc40e59b1cc5a6b34b6f8f',volume_id=ed2396ac-df7f-4fb8-b24b-b79d100c0a21) Jul 05 03:51:24.227193 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_9a2e18e6fd724ecabbdcdc1aed9f15d7 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:51:24.227794 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:51:24.228117 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:51:24.239193 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:51:24.258507 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:51:24.272769 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:51:24.272895 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:51:24.280930 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:51:24.281966 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:feba:17f3', 'fe80::e477:baff:fee9:cab5'] Jul 05 03:51:24.282153 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:51:24.282303 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:51:24.282600 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] <== get_connector_properties: return (53ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:51:24.786527 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:51:24.787116 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed2396ac-df7f-4fb8-b24b-b79d100c0a21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:51:24.787369 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:51:24.787968 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:51:24.788231 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed2396ac-df7f-4fb8-b24b-b79d100c0a21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:51:24.801017 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:51:24.801503 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:51:24.801886 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:51:24.813851 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:51:24.813851 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:51:24.825605 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21] added Jul 05 03:51:24.825605 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:51:24.825605 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:51:24.825605 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:51:24.825605 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:51:24.825605 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:51:24.825605 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:51:24.825873 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:51:24.826198 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0244(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:51:24.826388 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:51:25.827487 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:51:25.838829 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:51:25.848346 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:51:25.858406 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('-m', 'session'): stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:25.858406 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:25.858406 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:51:25.858596 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] iscsi session list stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:25.858596 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:25.858596 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:51:25.885911 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21, portal: 192.168.40.100,3260] Jul 05 03:51:25.885911 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21, portal: 192.168.40.100,3260] successful. Jul 05 03:51:25.885911 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:51:25.895546 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:51:25.906375 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('-m', 'session'): stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:25.906375 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:25.906375 np0000004562 cinder-backup[101413]: tcp: [236] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21 (non-flash) Jul 05 03:51:25.906375 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:51:25.906375 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] iscsi session list stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:25.906375 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:25.906375 np0000004562 cinder-backup[101413]: tcp: [236] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21 (non-flash) Jul 05 03:51:25.906375 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:51:25.906833 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.105s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:51:25.906967 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:51:25.907628 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] HCTL ('7', '-', '-', 0) found on session 236 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:51:25.907832 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:51:25.919156 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Searching for a device in session 236 and hctl ['7', '*', '*', 0] yield: None {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:51:26.919895 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Searching for a device in session 236 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:51:26.920362 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed2396ac-df7f-4fb8-b24b-b79d100c0a21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:51:26.920647 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.133s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:51:26.920857 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] <== connect_volume: return (2133ms) {'type': 'block', 'scsi_wwn': '330000000828c3788', 'path': '/dev/sdb'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:51:26.921167 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:51:26.937723 np0000004562 sudo[156979]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 05 03:51:26.938326 np0000004562 sudo[156979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:51:27.240802 np0000004562 sudo[156979]: pam_unix(sudo:session): session closed for user root Jul 05 03:51:27.242900 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.321s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:51:27.278078 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:51:27.284455 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] _create_container started, container: volumebackups,backup: 5f847480-ddde-44fe-a193-61b33cd86e02. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:51:27.368915 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] generate_object_name_prefix: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02 {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:51:27.373435 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] starting backup of volume: ed2396ac-df7f-4fb8-b24b-b79d100c0a21, volume size: 1073741824, object names prefix volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:51:27.572226 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:27.817013 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:27.817334 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:27.913515 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:27.913701 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:28.091003 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:28.354330 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:28.354510 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:28.464401 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:28.464629 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:28.664126 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:28.907477 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:28.907660 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:29.007348 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:29.007553 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:29.185393 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:29.423446 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:29.423580 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:29.521373 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:29.521539 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:29.702649 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:29.947668 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:29.947869 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:30.046014 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:30.046193 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:30.224148 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:30.466056 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:30.466181 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:30.562297 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:30.562440 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:30.734499 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:30.979366 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:30.979528 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:31.079873 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:31.080082 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:31.259002 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:31.506404 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:31.506662 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:31.610386 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:31.610535 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:31.798875 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:32.051037 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:32.051144 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:32.155664 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:32.155823 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:32.330110 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:32.569396 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:32.569655 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:32.669923 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:32.670167 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:32.855392 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:33.102745 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:33.102911 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:33.200790 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:33.200945 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:33.387496 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:33.628099 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:33.628282 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:33.730395 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:33.730550 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:33.921501 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:34.164341 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:34.164517 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:34.265111 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:34.265407 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:34.466188 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:34.718007 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:34.718267 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:34.817435 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:34.817685 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:35.009861 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:35.253652 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:35.253905 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:35.358920 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:35.359140 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:35.583483 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:35.821660 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:35.821855 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:35.919965 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:35.920108 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:36.098607 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:36.359409 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:36.359588 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:36.459212 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:36.459322 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:36.638059 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:36.878257 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:36.878401 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:36.980223 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:36.980357 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:37.159636 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:37.413425 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:37.413549 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:37.510361 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:37.510470 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:37.702821 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:37.953095 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:37.953208 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:38.049747 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:38.049995 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:38.147116 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:38.268747 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:38.268875 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:38.325190 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:38.325347 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:38.332683 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:51:38.339013 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:51:38.339198 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:51:38.343292 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:51:38.343412 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:51:38.346356 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:51:38.346564 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:51:38.399512 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:51:38.400192 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] _write_metadata started, container name: volumebackups, metadata filename: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:51:38.422084 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "5f847480-ddde-44fe-a193-61b33cd86e02",\n "backup_name": null,\n "created_at": "2026-07-05 03:51:24+00:00",\n "objects": [\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "ed2396ac-df7f-4fb8-b24b-b79d100c0a21",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"ed2396ac-df7f-4fb8-b24b-b79d100c0a21\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"b80b78941fd448ffbd4d016cc2facc64\\", \\"project_id\\": \\"9a2e18e6fd724ecabbdcdc1aed9f15d7\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:51:07.000000\\", \\"launched_at\\": \\"2026-07-05T03:51:07.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-2027233181\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:51:06.000000\\", \\"updated_at\\": \\"2026-07-05T03:51:24.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:51:38.426804 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] backup 5f847480-ddde-44fe-a193-61b33cd86e02 finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:51:38.547479 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:51:38.564465 np0000004562 sudo[157258]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 05 03:51:38.565083 np0000004562 sudo[157258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:51:38.853882 np0000004562 sudo[157258]: pam_unix(sudo:session): session closed for user root Jul 05 03:51:38.856015 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.308s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:51:38.856610 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed2396ac-df7f-4fb8-b24b-b79d100c0a21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000828c3788', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:51:38.856819 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:51:38.857295 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:51:38.857653 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed2396ac-df7f-4fb8-b24b-b79d100c0a21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:51:38.870025 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:51:38.870025 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:51:38.870025 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:51:38.870025 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:51:38.870025 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:51:38.870025 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21 Jul 05 03:51:38.870025 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:51:38.870025 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:51:38.870025 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a Jul 05 03:51:38.870025 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:51:38.870025 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:51:38.870025 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:51:38.870025 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:51:38.870025 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 Jul 05 03:51:38.870025 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:51:38.870025 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:51:38.870025 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:51:38.870025 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:51:38.870025 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:51:38.870025 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:51:38.870025 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:51:38.870525 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:51:38.870525 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:51:38.870525 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:51:38.870525 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:51:38.896284 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('-m', 'session'): stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:38.896284 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:38.896284 np0000004562 cinder-backup[101413]: tcp: [236] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21 (non-flash) Jul 05 03:51:38.896284 np0000004562 cinder-backup[101413]: tcp: [237] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a (non-flash) Jul 05 03:51:38.896284 np0000004562 cinder-backup[101413]: tcp: [238] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a (non-flash) Jul 05 03:51:38.896284 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:51:38.896522 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] iscsi session list stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:38.896522 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:38.896522 np0000004562 cinder-backup[101413]: tcp: [236] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21 (non-flash) Jul 05 03:51:38.896522 np0000004562 cinder-backup[101413]: tcp: [237] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a (non-flash) Jul 05 03:51:38.896522 np0000004562 cinder-backup[101413]: tcp: [238] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a (non-flash) Jul 05 03:51:38.896522 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:51:38.896637 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8', '232'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8', '233'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21', '236'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a', '237'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a', '238')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:51:38.896702 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21', '236')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:51:38.897568 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Resulting device map defaultdict(. at 0x72a47001dc60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21'): ({'sdb'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:51:38.897802 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Removing single pathed devices sdb {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:51:38.908450 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Flushing IO for device /dev/sdb {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:51:38.916267 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:51:38.963482 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:51:38.963694 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:51:38.964922 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:51:38.976053 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:51:38.976443 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:51:38.988164 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:51:39.019672 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 236, target: iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21, portal: 192.168.40.100,3260] Jul 05 03:51:39.019672 np0000004562 cinder-backup[101413]: Logout of [sid: 236, target: iqn.2023-03.storpool.com:os--volume-ed2396ac-df7f-4fb8-b24b-b79d100c0a21, portal: 192.168.40.100,3260] successful. Jul 05 03:51:39.019672 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:51:39.034602 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:51:39.034952 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.178s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:51:39.035153 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] <== disconnect_volume: return (178ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:51:40.055666 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-06b40603-eaaa-4b19-9239-bf81bc830bda tempest-ProjectMemberTests33-1641103150 None] Create backup finished. backup: 5f847480-ddde-44fe-a193-61b33cd86e02. Jul 05 03:51:40.550150 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-349fed8d-0839-458a-bfa5-39524f0c4044 tempest-ProjectMemberTests33-1641103150 None] Delete backup started, backup: 5f847480-ddde-44fe-a193-61b33cd86e02. Jul 05 03:51:40.558605 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-349fed8d-0839-458a-bfa5-39524f0c4044 tempest-ProjectMemberTests33-1641103150 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_9a2e18e6fd724ecabbdcdc1aed9f15d7 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:51:40.559024 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-349fed8d-0839-458a-bfa5-39524f0c4044 tempest-ProjectMemberTests33-1641103150 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:51:40.559240 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-349fed8d-0839-458a-bfa5-39524f0c4044 tempest-ProjectMemberTests33-1641103150 None] delete started, backup: 5f847480-ddde-44fe-a193-61b33cd86e02, container: volumebackups, prefix: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:51:40.601212 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-349fed8d-0839-458a-bfa5-39524f0c4044 tempest-ProjectMemberTests33-1641103150 None] generated object list: ['volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00001', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00002', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00003', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00004', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00005', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00006', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00007', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00008', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00009', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00010', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00011', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00012', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00013', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00014', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00015', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00016', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00017', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00018', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00019', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00020', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00021', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02_metadata', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:51:40.619014 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-349fed8d-0839-458a-bfa5-39524f0c4044 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00001 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:40.638150 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-349fed8d-0839-458a-bfa5-39524f0c4044 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00002 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:40.657026 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-349fed8d-0839-458a-bfa5-39524f0c4044 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00003 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:40.674711 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-349fed8d-0839-458a-bfa5-39524f0c4044 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00004 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:40.697153 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-349fed8d-0839-458a-bfa5-39524f0c4044 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00005 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:40.722734 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-349fed8d-0839-458a-bfa5-39524f0c4044 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00006 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:40.738333 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-349fed8d-0839-458a-bfa5-39524f0c4044 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00007 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:40.757094 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-349fed8d-0839-458a-bfa5-39524f0c4044 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00008 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:40.777077 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-349fed8d-0839-458a-bfa5-39524f0c4044 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00009 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:40.795033 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-349fed8d-0839-458a-bfa5-39524f0c4044 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00010 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:40.813040 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-349fed8d-0839-458a-bfa5-39524f0c4044 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00011 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:40.831920 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-349fed8d-0839-458a-bfa5-39524f0c4044 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00012 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:40.848831 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-349fed8d-0839-458a-bfa5-39524f0c4044 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00013 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:40.867337 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-349fed8d-0839-458a-bfa5-39524f0c4044 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00014 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:40.886239 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-349fed8d-0839-458a-bfa5-39524f0c4044 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00015 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:40.904561 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-349fed8d-0839-458a-bfa5-39524f0c4044 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00016 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:40.922640 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-349fed8d-0839-458a-bfa5-39524f0c4044 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00017 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:40.940074 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-349fed8d-0839-458a-bfa5-39524f0c4044 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00018 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:40.958003 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-349fed8d-0839-458a-bfa5-39524f0c4044 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00019 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:40.974304 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-349fed8d-0839-458a-bfa5-39524f0c4044 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00020 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:40.993388 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-349fed8d-0839-458a-bfa5-39524f0c4044 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02-00021 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:41.014315 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-349fed8d-0839-458a-bfa5-39524f0c4044 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02_metadata in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:41.032945 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-349fed8d-0839-458a-bfa5-39524f0c4044 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035127/az_nova_backup_5f847480-ddde-44fe-a193-61b33cd86e02_sha256file in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:41.033202 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-349fed8d-0839-458a-bfa5-39524f0c4044 tempest-ProjectMemberTests33-1641103150 None] delete 5f847480-ddde-44fe-a193-61b33cd86e02 finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:51:41.065691 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-349fed8d-0839-458a-bfa5-39524f0c4044 tempest-ProjectMemberTests33-1641103150 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:51:41.079276 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-349fed8d-0839-458a-bfa5-39524f0c4044 tempest-ProjectMemberTests33-1641103150 None] Created reservations ['fb1a74d8-1aed-4f3d-93f4-dfe26e693517', '63f6c35f-7d4b-403c-a736-ead714f6d21a'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:51:41.094132 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-349fed8d-0839-458a-bfa5-39524f0c4044 tempest-ProjectMemberTests33-1641103150 None] Delete backup finished, backup 5f847480-ddde-44fe-a193-61b33cd86e02 deleted. Jul 05 03:51:41.838040 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Create backup started, backup: 6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f volume: 7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db. Jul 05 03:51:41.841875 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T03:51:41Z,data_timestamp=2026-07-05T03:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-1053174859',encryption_key_id=None,fail_reason=None,host='np0000004562',id=6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='9a2e18e6fd724ecabbdcdc1aed9f15d7',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='b80b78941fd448ffbd4d016cc2facc64',volume_id=7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db) Jul 05 03:51:41.865356 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_9a2e18e6fd724ecabbdcdc1aed9f15d7 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:51:41.865692 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:51:41.866020 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:51:41.877414 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:51:41.899027 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:51:41.912210 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:51:41.912466 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:51:41.920062 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:51:41.921026 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:feba:17f3', 'fe80::e477:baff:fee9:cab5', 'fe80::f816:3eff:fe33:77c'] Jul 05 03:51:41.921146 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:51:41.921297 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:51:41.921542 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] <== get_connector_properties: return (54ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:51:42.425348 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:51:42.425786 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:51:42.426058 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:51:42.426561 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:51:42.426883 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:51:42.437796 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:51:42.438249 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:51:42.438476 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:51:42.448438 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:51:42.448438 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:51:42.460198 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db] added Jul 05 03:51:42.460198 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:51:42.460198 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:51:42.460198 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:51:42.460198 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:51:42.460198 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:51:42.460198 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:51:42.460440 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:51:42.460786 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0222(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:51:42.460984 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:51:43.462128 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:51:43.473526 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:51:43.484055 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:51:43.495824 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('-m', 'session'): stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:43.495824 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:43.495824 np0000004562 cinder-backup[101413]: tcp: [237] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a (non-flash) Jul 05 03:51:43.495824 np0000004562 cinder-backup[101413]: tcp: [238] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a (non-flash) Jul 05 03:51:43.495824 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:51:43.496049 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] iscsi session list stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:43.496049 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:43.496049 np0000004562 cinder-backup[101413]: tcp: [237] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a (non-flash) Jul 05 03:51:43.496049 np0000004562 cinder-backup[101413]: tcp: [238] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a (non-flash) Jul 05 03:51:43.496049 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:51:43.531230 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db, portal: 192.168.40.100,3260] Jul 05 03:51:43.531230 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db, portal: 192.168.40.100,3260] successful. Jul 05 03:51:43.531230 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:51:43.541005 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:51:43.553547 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('-m', 'session'): stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:43.553547 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:43.553547 np0000004562 cinder-backup[101413]: tcp: [237] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a (non-flash) Jul 05 03:51:43.553547 np0000004562 cinder-backup[101413]: tcp: [238] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a (non-flash) Jul 05 03:51:43.553547 np0000004562 cinder-backup[101413]: tcp: [239] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db (non-flash) Jul 05 03:51:43.553547 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:51:43.553825 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] iscsi session list stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:43.553825 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:43.553825 np0000004562 cinder-backup[101413]: tcp: [237] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a (non-flash) Jul 05 03:51:43.553825 np0000004562 cinder-backup[101413]: tcp: [238] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a (non-flash) Jul 05 03:51:43.553825 np0000004562 cinder-backup[101413]: tcp: [239] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db (non-flash) Jul 05 03:51:43.553825 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:51:43.554064 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.116s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:51:43.554195 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:51:43.554948 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] HCTL ('7', '-', '-', 0) found on session 239 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:51:43.555115 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:51:43.567076 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Searching for a device in session 239 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:51:43.567317 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:51:44.571218 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.144s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:51:44.571610 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] <== connect_volume: return (2145ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799272', 'path': '/dev/sdb'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:51:44.571819 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:51:44.591103 np0000004562 sudo[157414]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 05 03:51:44.591791 np0000004562 sudo[157414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:51:44.910595 np0000004562 sudo[157414]: pam_unix(sudo:session): session closed for user root Jul 05 03:51:44.912605 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.340s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:51:44.950019 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:51:44.955599 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] _create_container started, container: volumebackups,backup: 6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:51:44.981648 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] generate_object_name_prefix: volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:51:44.985792 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] starting backup of volume: 7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db, volume size: 1073741824, object names prefix volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:51:45.158637 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:45.403668 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:45.403968 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:45.503296 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:45.503451 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:45.689035 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:45.940289 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:45.940393 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:46.044438 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:46.044603 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:46.221960 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:46.473171 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:46.473299 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:46.570261 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:46.570473 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:46.757402 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:46.998467 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:46.998622 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:47.097419 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:47.097603 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:47.278694 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:47.520754 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:47.521015 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:47.617851 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:47.618028 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:47.794080 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:48.031201 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:48.031425 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:48.134765 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:48.134954 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:48.305290 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:48.548832 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:48.549005 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:48.649315 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:48.649544 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:48.840894 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:49.080853 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:49.081022 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:49.182534 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:49.182686 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:49.358186 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:49.599069 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:49.599222 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:49.697358 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:49.697562 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:49.876241 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:50.116533 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:50.116812 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:50.213784 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:50.213984 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:50.382355 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:50.620625 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:50.620907 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:50.719730 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:50.719927 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:50.898569 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:51.145455 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:51.145670 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:51.242463 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:51.242693 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:51.427450 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:51.669253 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:51.669447 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:51.766923 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:51.767089 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:51.939127 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:52.181968 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:52.182085 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:52.278788 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:52.278924 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:52.443436 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:52.679361 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:52.679558 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:52.781596 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:52.781786 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:52.938871 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:53.179352 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:53.179795 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:53.275198 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:53.275368 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:53.462338 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:53.701130 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:53.701267 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:53.796184 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:53.796349 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:53.967854 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:54.208548 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:54.208989 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:54.307215 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:54.307403 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:54.488478 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:54.732523 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:54.732523 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:54.831806 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:54.832005 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:55.004302 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:55.246373 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:55.246782 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:55.345416 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:55.345630 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:55.437833 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:51:55.560500 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:51:55.560615 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:51:55.621801 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:51:55.621801 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:51:55.627943 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:51:55.633207 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:51:55.633342 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:51:55.637275 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:51:55.637393 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:51:55.640274 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:51:55.640499 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:51:55.693606 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:51:55.694523 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] _write_metadata started, container name: volumebackups, metadata filename: volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:51:55.718053 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f",\n "backup_name": "tempest-type-Backup-1053174859",\n "created_at": "2026-07-05 03:51:42+00:00",\n "objects": [\n {\n "volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"b80b78941fd448ffbd4d016cc2facc64\\", \\"project_id\\": \\"9a2e18e6fd724ecabbdcdc1aed9f15d7\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:51:41.000000\\", \\"launched_at\\": \\"2026-07-05T03:51:41.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-2073636133\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:51:41.000000\\", \\"updated_at\\": \\"2026-07-05T03:51:42.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:51:55.722915 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] backup 6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:51:55.840860 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:51:55.859477 np0000004562 sudo[157434]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 05 03:51:55.860187 np0000004562 sudo[157434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:51:56.159114 np0000004562 sudo[157434]: pam_unix(sudo:session): session closed for user root Jul 05 03:51:56.161225 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.320s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:51:56.161992 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799272', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:51:56.162268 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:51:56.162915 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:51:56.163355 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:51:56.173756 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:51:56.173756 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:51:56.173756 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:51:56.173756 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:51:56.173756 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:51:56.173756 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a Jul 05 03:51:56.173756 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:51:56.173756 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:51:56.173756 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:51:56.173756 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:51:56.173756 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db Jul 05 03:51:56.173756 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:51:56.173756 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:51:56.173756 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 Jul 05 03:51:56.173756 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:51:56.173756 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:51:56.173756 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:51:56.173756 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:51:56.173756 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:51:56.173756 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:51:56.173756 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:51:56.174221 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:51:56.174221 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:51:56.174221 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:51:56.174284 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:51:56.199129 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('-m', 'session'): stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:56.199129 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:56.199129 np0000004562 cinder-backup[101413]: tcp: [237] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a (non-flash) Jul 05 03:51:56.199129 np0000004562 cinder-backup[101413]: tcp: [238] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a (non-flash) Jul 05 03:51:56.199129 np0000004562 cinder-backup[101413]: tcp: [239] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db (non-flash) Jul 05 03:51:56.199129 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:51:56.199482 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] iscsi session list stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:56.199482 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:51:56.199482 np0000004562 cinder-backup[101413]: tcp: [237] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a (non-flash) Jul 05 03:51:56.199482 np0000004562 cinder-backup[101413]: tcp: [238] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a (non-flash) Jul 05 03:51:56.199482 np0000004562 cinder-backup[101413]: tcp: [239] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db (non-flash) Jul 05 03:51:56.199482 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:51:56.199482 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8', '232'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8', '233'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a', '237'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a', '238'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db', '239')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:51:56.199755 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db', '239')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:51:56.200728 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Resulting device map defaultdict(. at 0x72a48ebbbec0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db'): ({'sdb'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:51:56.200991 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Removing single pathed devices sdb {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:51:56.212152 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Flushing IO for device /dev/sdb {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:51:56.220529 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:51:56.258088 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:51:56.258455 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:51:56.259346 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:51:56.269600 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:51:56.269904 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:51:56.280474 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:51:56.321722 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 239, target: iqn.2023-03.storpool.com:os--volume-7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db, portal: 192.168.40.100,3260] Jul 05 03:51:56.321722 np0000004562 cinder-backup[101413]: Logout of [sid: 239, target: iqn.2023-03.storpool.com:os--volume-7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db, portal: 192.168.40.100,3260] successful. Jul 05 03:51:56.321722 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:51:56.334610 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:51:56.334912 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.172s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:51:56.335091 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] <== disconnect_volume: return (173ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:51:57.354608 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-759abed9-2f8c-4947-b1ae-1e94b410288b tempest-ProjectMemberTests33-1641103150 None] Create backup finished. backup: 6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f. Jul 05 03:51:58.151424 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-1769a43d-af8a-4e37-9e46-76825ce21d33 tempest-ProjectMemberTests33-1641103150 None] Delete backup started, backup: 6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f. Jul 05 03:51:58.159681 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-1769a43d-af8a-4e37-9e46-76825ce21d33 tempest-ProjectMemberTests33-1641103150 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_9a2e18e6fd724ecabbdcdc1aed9f15d7 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:51:58.160026 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-1769a43d-af8a-4e37-9e46-76825ce21d33 tempest-ProjectMemberTests33-1641103150 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:51:58.160812 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1769a43d-af8a-4e37-9e46-76825ce21d33 tempest-ProjectMemberTests33-1641103150 None] delete started, backup: 6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f, container: volumebackups, prefix: volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:51:58.205436 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1769a43d-af8a-4e37-9e46-76825ce21d33 tempest-ProjectMemberTests33-1641103150 None] generated object list: ['volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00001', 'volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00002', 'volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00003', 'volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00004', 'volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00005', 'volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00006', 'volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00007', 'volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00008', 'volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00009', 'volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00010', 'volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00011', 'volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00012', 'volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00013', 'volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00014', 'volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00015', 'volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00016', 'volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00017', 'volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00018', 'volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00019', 'volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00020', 'volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00021', 'volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f_metadata', 'volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:51:58.223272 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1769a43d-af8a-4e37-9e46-76825ce21d33 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00001 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:58.240292 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1769a43d-af8a-4e37-9e46-76825ce21d33 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00002 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:58.258088 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1769a43d-af8a-4e37-9e46-76825ce21d33 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00003 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:58.277470 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1769a43d-af8a-4e37-9e46-76825ce21d33 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00004 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:58.296094 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1769a43d-af8a-4e37-9e46-76825ce21d33 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00005 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:58.314418 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1769a43d-af8a-4e37-9e46-76825ce21d33 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00006 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:58.331801 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1769a43d-af8a-4e37-9e46-76825ce21d33 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00007 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:58.347891 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1769a43d-af8a-4e37-9e46-76825ce21d33 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00008 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:58.365679 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1769a43d-af8a-4e37-9e46-76825ce21d33 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00009 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:58.382309 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1769a43d-af8a-4e37-9e46-76825ce21d33 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00010 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:58.399847 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1769a43d-af8a-4e37-9e46-76825ce21d33 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00011 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:58.415907 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1769a43d-af8a-4e37-9e46-76825ce21d33 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00012 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:58.431464 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1769a43d-af8a-4e37-9e46-76825ce21d33 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00013 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:58.447387 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1769a43d-af8a-4e37-9e46-76825ce21d33 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00014 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:58.465211 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1769a43d-af8a-4e37-9e46-76825ce21d33 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00015 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:58.483287 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1769a43d-af8a-4e37-9e46-76825ce21d33 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00016 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:58.501781 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1769a43d-af8a-4e37-9e46-76825ce21d33 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00017 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:58.519577 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1769a43d-af8a-4e37-9e46-76825ce21d33 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00018 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:58.537047 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1769a43d-af8a-4e37-9e46-76825ce21d33 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00019 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:58.555294 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1769a43d-af8a-4e37-9e46-76825ce21d33 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00020 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:58.572409 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1769a43d-af8a-4e37-9e46-76825ce21d33 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f-00021 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:58.591300 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1769a43d-af8a-4e37-9e46-76825ce21d33 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f_metadata in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:58.613901 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1769a43d-af8a-4e37-9e46-76825ce21d33 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7c3d45c0-7c8f-4d7a-ad2e-5c76681f10db/20260705035144/az_nova_backup_6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f_sha256file in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:51:58.614169 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-1769a43d-af8a-4e37-9e46-76825ce21d33 tempest-ProjectMemberTests33-1641103150 None] delete 6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:51:58.645883 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-1769a43d-af8a-4e37-9e46-76825ce21d33 tempest-ProjectMemberTests33-1641103150 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:51:58.657840 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-1769a43d-af8a-4e37-9e46-76825ce21d33 tempest-ProjectMemberTests33-1641103150 None] Created reservations ['44b2eb3f-504e-46de-8982-35bef9e3288b', '10a8f952-279c-4078-8d64-d787fefc6248'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:51:58.671112 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-1769a43d-af8a-4e37-9e46-76825ce21d33 tempest-ProjectMemberTests33-1641103150 None] Delete backup finished, backup 6d3f35d1-d1c9-4ea6-961a-e7ecde2d8c8f deleted. Jul 05 03:52:00.536981 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Create backup started, backup: ddc355a8-072b-43a2-b994-c648dc0b4864 volume: 6ce2044a-33d2-4548-b48f-9ec9dcaa9560. Jul 05 03:52:00.541435 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T03:52:00Z,data_timestamp=2026-07-05T03:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-404148127',encryption_key_id=None,fail_reason=None,host='np0000004562',id=ddc355a8-072b-43a2-b994-c648dc0b4864,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='9a2e18e6fd724ecabbdcdc1aed9f15d7',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='b80b78941fd448ffbd4d016cc2facc64',volume_id=6ce2044a-33d2-4548-b48f-9ec9dcaa9560) Jul 05 03:52:00.564886 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_9a2e18e6fd724ecabbdcdc1aed9f15d7 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:52:00.565329 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:52:00.565783 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:52:00.575190 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:52:00.593127 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:52:00.605545 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:52:00.605876 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:52:00.613462 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:52:00.614435 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:feba:17f3', 'fe80::e477:baff:fee9:cab5', 'fe80::f816:3eff:fe33:77c'] Jul 05 03:52:00.614590 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:52:00.614772 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:52:00.615026 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] <== get_connector_properties: return (49ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:52:01.118938 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:52:01.119396 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6ce2044a-33d2-4548-b48f-9ec9dcaa9560', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6ce2044a-33d2-4548-b48f-9ec9dcaa9560', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:52:01.119566 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:52:01.120097 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:52:01.120307 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6ce2044a-33d2-4548-b48f-9ec9dcaa9560', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6ce2044a-33d2-4548-b48f-9ec9dcaa9560', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:52:01.132093 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6ce2044a-33d2-4548-b48f-9ec9dcaa9560" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:52:01.132478 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6ce2044a-33d2-4548-b48f-9ec9dcaa9560" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:52:01.132682 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:52:01.143522 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:52:01.143522 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:52:01.155304 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6ce2044a-33d2-4548-b48f-9ec9dcaa9560] added Jul 05 03:52:01.155304 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:52:01.155304 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:52:01.155304 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:52:01.155304 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:52:01.155304 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:52:01.155304 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:52:01.155533 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:52:01.155928 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0231(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:52:01.156155 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:52:02.157734 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-6ce2044a-33d2-4548-b48f-9ec9dcaa9560 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:52:02.168430 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:52:02.179161 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:52:02.190517 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('-m', 'session'): stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:52:02.190517 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:52:02.190517 np0000004562 cinder-backup[101413]: tcp: [237] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a (non-flash) Jul 05 03:52:02.190517 np0000004562 cinder-backup[101413]: tcp: [238] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a (non-flash) Jul 05 03:52:02.190517 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:52:02.190798 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] iscsi session list stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:52:02.190798 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:52:02.190798 np0000004562 cinder-backup[101413]: tcp: [237] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a (non-flash) Jul 05 03:52:02.190798 np0000004562 cinder-backup[101413]: tcp: [238] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a (non-flash) Jul 05 03:52:02.190798 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:52:02.222248 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6ce2044a-33d2-4548-b48f-9ec9dcaa9560, portal: 192.168.40.100,3260] Jul 05 03:52:02.222248 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6ce2044a-33d2-4548-b48f-9ec9dcaa9560, portal: 192.168.40.100,3260] successful. Jul 05 03:52:02.222248 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:52:02.232299 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:52:02.245669 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('-m', 'session'): stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:52:02.245669 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:52:02.245669 np0000004562 cinder-backup[101413]: tcp: [237] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a (non-flash) Jul 05 03:52:02.245669 np0000004562 cinder-backup[101413]: tcp: [238] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a (non-flash) Jul 05 03:52:02.245669 np0000004562 cinder-backup[101413]: tcp: [240] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ce2044a-33d2-4548-b48f-9ec9dcaa9560 (non-flash) Jul 05 03:52:02.245669 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:52:02.245899 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] iscsi session list stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:52:02.245899 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:52:02.245899 np0000004562 cinder-backup[101413]: tcp: [237] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a (non-flash) Jul 05 03:52:02.245899 np0000004562 cinder-backup[101413]: tcp: [238] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a (non-flash) Jul 05 03:52:02.245899 np0000004562 cinder-backup[101413]: tcp: [240] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ce2044a-33d2-4548-b48f-9ec9dcaa9560 (non-flash) Jul 05 03:52:02.245899 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:52:02.246143 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6ce2044a-33d2-4548-b48f-9ec9dcaa9560" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.114s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:52:02.246273 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:52:02.246984 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] HCTL ('7', '-', '-', 0) found on session 240 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:52:02.247112 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:52:02.259476 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Searching for a device in session 240 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:52:02.259772 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6ce2044a-33d2-4548-b48f-9ec9dcaa9560', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6ce2044a-33d2-4548-b48f-9ec9dcaa9560', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:52:03.263620 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.143s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:52:03.264239 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] <== connect_volume: return (2144ms) {'type': 'block', 'scsi_wwn': '33000000042eae60a', 'path': '/dev/sdb'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:52:03.264239 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:52:03.282406 np0000004562 sudo[157534]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 05 03:52:03.283161 np0000004562 sudo[157534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:52:03.568884 np0000004562 sudo[157534]: pam_unix(sudo:session): session closed for user root Jul 05 03:52:03.571360 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.307s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:52:03.612011 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:52:03.618528 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] _create_container started, container: volumebackups,backup: ddc355a8-072b-43a2-b994-c648dc0b4864. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:52:03.647733 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] generate_object_name_prefix: volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864 {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:52:03.653816 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] starting backup of volume: 6ce2044a-33d2-4548-b48f-9ec9dcaa9560, volume size: 1073741824, object names prefix volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:52:03.834195 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:04.071054 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:04.071270 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:04.169082 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:04.169226 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:04.354751 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:04.595589 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:04.595813 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:04.699576 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:04.699792 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:04.882152 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:05.120682 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:05.120920 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:05.219610 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:05.219914 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:05.387357 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:05.626488 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:05.626684 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:05.726079 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:05.726250 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:05.924653 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:06.166324 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:06.166448 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:06.268295 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:06.268413 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:06.470788 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:06.713407 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:06.713577 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:06.814195 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:06.814340 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:06.997195 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:07.235988 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:07.236164 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:07.333572 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:07.333850 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:07.513613 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:07.786885 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:07.786987 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:07.883818 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:07.884071 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:07.885510 np0000004562 cinder-backup[101413]: DEBUG dbcounter [-] [101413] Writing DB stats cinder:SELECT=120,cinder:UPDATE=34,cinder:INSERT=4 {{(pid=101413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:52:08.069851 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:08.309617 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:08.309892 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:08.406374 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:08.406578 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:08.614171 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:08.854180 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:08.854431 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:08.953805 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:08.953996 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:09.139289 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:09.379544 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:09.379727 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:09.476347 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:09.476585 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:09.648652 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:09.886992 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:09.887128 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:09.984098 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:09.984240 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:10.159570 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:10.397090 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:10.397285 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:10.498531 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:10.499199 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:10.670498 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:10.911164 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:10.911379 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:11.015305 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:11.015537 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:11.187509 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:11.430256 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:11.430426 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:11.530638 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:11.530854 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:11.707805 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:11.797525 np0000004562 cinder-backup[101413]: DEBUG oslo_service.periodic_task [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:52:11.797693 np0000004562 cinder-backup[101413]: DEBUG cinder.manager [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Notifying Schedulers of capabilities ... {{(pid=101413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:52:11.947954 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:11.948224 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:12.047602 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:12.047803 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:12.231918 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:12.467295 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:12.467433 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:12.565745 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:12.565930 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:12.749263 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:12.990978 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:12.991132 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:13.086414 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:13.086553 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:13.277633 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:13.521301 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:13.521517 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:13.617335 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:13.617538 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:13.807295 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:14.047954 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:14.048153 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:14.153814 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:14.153982 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:14.243341 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:14.358291 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:14.358493 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:14.419022 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:14.419185 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:14.425925 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:52:14.430970 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:52:14.431135 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:52:14.435089 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:52:14.435250 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:52:14.438039 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:52:14.438261 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:52:14.490761 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:52:14.491559 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] _write_metadata started, container name: volumebackups, metadata filename: volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:52:14.513819 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "ddc355a8-072b-43a2-b994-c648dc0b4864",\n "backup_name": "tempest-type-Backup-404148127",\n "created_at": "2026-07-05 03:52:00+00:00",\n "objects": [\n {\n "volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "6ce2044a-33d2-4548-b48f-9ec9dcaa9560",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"6ce2044a-33d2-4548-b48f-9ec9dcaa9560\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"b80b78941fd448ffbd4d016cc2facc64\\", \\"project_id\\": \\"9a2e18e6fd724ecabbdcdc1aed9f15d7\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:51:59.000000\\", \\"launched_at\\": \\"2026-07-05T03:52:00.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-408681853\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:51:59.000000\\", \\"updated_at\\": \\"2026-07-05T03:52:00.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:52:14.519757 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] backup ddc355a8-072b-43a2-b994-c648dc0b4864 finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:52:14.657175 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:52:14.675243 np0000004562 sudo[157553]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 05 03:52:14.675899 np0000004562 sudo[157553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:52:14.992471 np0000004562 sudo[157553]: pam_unix(sudo:session): session closed for user root Jul 05 03:52:14.994724 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.337s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:52:14.995460 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6ce2044a-33d2-4548-b48f-9ec9dcaa9560', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6ce2044a-33d2-4548-b48f-9ec9dcaa9560', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '33000000042eae60a', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:52:14.995733 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:52:14.996255 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:52:14.996697 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6ce2044a-33d2-4548-b48f-9ec9dcaa9560', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6ce2044a-33d2-4548-b48f-9ec9dcaa9560', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:52:15.007394 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:52:15.007394 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:52:15.007394 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:52:15.007394 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:52:15.007394 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:52:15.007394 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-6ce2044a-33d2-4548-b48f-9ec9dcaa9560 Jul 05 03:52:15.007394 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:52:15.007394 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:52:15.007394 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a Jul 05 03:52:15.007394 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:52:15.007394 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:52:15.007394 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:52:15.007394 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:52:15.007394 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 Jul 05 03:52:15.007394 np0000004562 cinder-backup[101413]: Portal: 192.168.50.100:3260,-1 Jul 05 03:52:15.007394 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:52:15.007394 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:52:15.007394 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:52:15.007394 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:52:15.007394 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:52:15.007394 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:52:15.008096 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:52:15.008096 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:52:15.008096 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:52:15.008096 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ce2044a-33d2-4548-b48f-9ec9dcaa9560', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:52:15.030778 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('-m', 'session'): stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:52:15.030778 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:52:15.030778 np0000004562 cinder-backup[101413]: tcp: [237] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a (non-flash) Jul 05 03:52:15.030778 np0000004562 cinder-backup[101413]: tcp: [238] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a (non-flash) Jul 05 03:52:15.030778 np0000004562 cinder-backup[101413]: tcp: [240] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ce2044a-33d2-4548-b48f-9ec9dcaa9560 (non-flash) Jul 05 03:52:15.030778 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:52:15.031026 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] iscsi session list stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:52:15.031026 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:52:15.031026 np0000004562 cinder-backup[101413]: tcp: [237] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a (non-flash) Jul 05 03:52:15.031026 np0000004562 cinder-backup[101413]: tcp: [238] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a (non-flash) Jul 05 03:52:15.031026 np0000004562 cinder-backup[101413]: tcp: [240] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ce2044a-33d2-4548-b48f-9ec9dcaa9560 (non-flash) Jul 05 03:52:15.031026 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:52:15.031142 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8', '232'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8', '233'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a', '237'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f771ff-fd68-45b5-ba87-e0d185bf5a6a', '238'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ce2044a-33d2-4548-b48f-9ec9dcaa9560', '240')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:52:15.031271 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6ce2044a-33d2-4548-b48f-9ec9dcaa9560, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ce2044a-33d2-4548-b48f-9ec9dcaa9560', '240')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:52:15.032219 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Resulting device map defaultdict(. at 0x72a46fd2a700>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ce2044a-33d2-4548-b48f-9ec9dcaa9560'): ({'sdb'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:52:15.032425 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Removing single pathed devices sdb {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:52:15.042840 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Flushing IO for device /dev/sdb {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:52:15.050310 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:52:15.087122 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:52:15.087302 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:52:15.088431 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:52:15.098511 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:52:15.098778 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ce2044a-33d2-4548-b48f-9ec9dcaa9560')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:52:15.108957 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:52:15.136586 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 240, target: iqn.2023-03.storpool.com:os--volume-6ce2044a-33d2-4548-b48f-9ec9dcaa9560, portal: 192.168.40.100,3260] Jul 05 03:52:15.136586 np0000004562 cinder-backup[101413]: Logout of [sid: 240, target: iqn.2023-03.storpool.com:os--volume-6ce2044a-33d2-4548-b48f-9ec9dcaa9560, portal: 192.168.40.100,3260] successful. Jul 05 03:52:15.136586 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:52:15.150082 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:52:15.150311 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.154s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:52:15.150483 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] <== disconnect_volume: return (154ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:52:16.180083 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-5a52a93b-8e0f-4d14-b367-57cd891e6d9f tempest-ProjectMemberTests33-1641103150 None] Create backup finished. backup: ddc355a8-072b-43a2-b994-c648dc0b4864. Jul 05 03:52:16.869964 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-e10c6a10-c839-4c10-b5cf-cc124158022c tempest-ProjectMemberTests33-1641103150 None] Export record started, backup: ddc355a8-072b-43a2-b994-c648dc0b4864. Jul 05 03:52:16.877337 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-e10c6a10-c839-4c10-b5cf-cc124158022c tempest-ProjectMemberTests33-1641103150 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_9a2e18e6fd724ecabbdcdc1aed9f15d7 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:52:16.877707 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-e10c6a10-c839-4c10-b5cf-cc124158022c tempest-ProjectMemberTests33-1641103150 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:52:16.878049 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-e10c6a10-c839-4c10-b5cf-cc124158022c tempest-ProjectMemberTests33-1641103150 None] Export record finished, backup ddc355a8-072b-43a2-b994-c648dc0b4864 exported. Jul 05 03:52:19.823166 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:52:19.829479 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Create backup started, backup: 997dfc3a-50a3-42d1-9625-e5cca6eb2a5c volume: 7531b601-d561-420e-be44-7f77f76357e8. Jul 05 03:52:19.833622 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T03:52:19Z,data_timestamp=2026-07-05T03:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-1053773301',encryption_key_id=None,fail_reason=None,host='np0000004562',id=997dfc3a-50a3-42d1-9625-e5cca6eb2a5c,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='9a2e18e6fd724ecabbdcdc1aed9f15d7',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='b80b78941fd448ffbd4d016cc2facc64',volume_id=7531b601-d561-420e-be44-7f77f76357e8) Jul 05 03:52:19.855475 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_9a2e18e6fd724ecabbdcdc1aed9f15d7 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:52:19.855837 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:52:19.856268 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:52:19.865488 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:52:19.884463 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:52:19.897730 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:52:19.898037 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:52:19.906419 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:52:19.907369 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544', 'fe80::f816:3eff:feba:17f3', 'fe80::e477:baff:fee9:cab5'] Jul 05 03:52:19.907526 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:52:19.907668 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:52:19.907944 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] <== get_connector_properties: return (51ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:52:20.411444 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:52:20.411927 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7531b601-d561-420e-be44-7f77f76357e8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7531b601-d561-420e-be44-7f77f76357e8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:52:20.412114 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:52:20.412663 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:52:20.412942 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7531b601-d561-420e-be44-7f77f76357e8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7531b601-d561-420e-be44-7f77f76357e8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:52:20.423458 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7531b601-d561-420e-be44-7f77f76357e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:52:20.423900 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7531b601-d561-420e-be44-7f77f76357e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:52:20.424145 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:52:20.433675 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:52:20.433675 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:52:20.444479 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7531b601-d561-420e-be44-7f77f76357e8] added Jul 05 03:52:20.444479 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:52:20.444479 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:52:20.444479 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:52:20.444479 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:52:20.444479 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:52:20.444479 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:52:20.444832 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:52:20.445122 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0209(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:52:20.445381 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:52:21.446997 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-7531b601-d561-420e-be44-7f77f76357e8 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:52:21.457692 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:52:21.468489 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:52:21.480310 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('-m', 'session'): stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:52:21.480310 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:52:21.480310 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:52:21.480520 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] iscsi session list stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:52:21.480520 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:52:21.480520 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:52:21.511251 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7531b601-d561-420e-be44-7f77f76357e8, portal: 192.168.40.100,3260] Jul 05 03:52:21.511251 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7531b601-d561-420e-be44-7f77f76357e8, portal: 192.168.40.100,3260] successful. Jul 05 03:52:21.511251 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:52:21.521891 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:52:21.533382 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('-m', 'session'): stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:52:21.533382 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:52:21.533382 np0000004562 cinder-backup[101413]: tcp: [241] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7531b601-d561-420e-be44-7f77f76357e8 (non-flash) Jul 05 03:52:21.533382 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:52:21.533617 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] iscsi session list stdout=tcp: [232] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:52:21.533617 np0000004562 cinder-backup[101413]: tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fefd1f0b-3991-4b9f-ae7e-d4d43ef025e8 (non-flash) Jul 05 03:52:21.533617 np0000004562 cinder-backup[101413]: tcp: [241] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7531b601-d561-420e-be44-7f77f76357e8 (non-flash) Jul 05 03:52:21.533617 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:52:21.533981 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7531b601-d561-420e-be44-7f77f76357e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.110s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:52:21.534114 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:52:21.534675 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] HCTL ('7', '-', '-', 0) found on session 241 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:52:21.534847 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:52:21.548603 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Searching for a device in session 241 and hctl ['7', '*', '*', 0] yield: None {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:52:22.549617 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Searching for a device in session 241 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:52:22.549617 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7531b601-d561-420e-be44-7f77f76357e8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7531b601-d561-420e-be44-7f77f76357e8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:52:22.550220 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.138s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:52:22.550441 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] <== connect_volume: return (2138ms) {'type': 'block', 'scsi_wwn': '3300000000e85a404', 'path': '/dev/sdb'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:52:22.550858 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:52:22.569231 np0000004562 sudo[157734]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 05 03:52:22.569907 np0000004562 sudo[157734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:52:22.880421 np0000004562 sudo[157734]: pam_unix(sudo:session): session closed for user root Jul 05 03:52:22.882875 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.332s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:52:22.924076 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:52:22.930398 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] _create_container started, container: volumebackups,backup: 997dfc3a-50a3-42d1-9625-e5cca6eb2a5c. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:52:22.955795 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] generate_object_name_prefix: volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:52:22.960952 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] starting backup of volume: 7531b601-d561-420e-be44-7f77f76357e8, volume size: 1073741824, object names prefix volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:52:23.135906 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:23.387404 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:23.387603 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:23.487559 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:23.487773 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:23.660738 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:23.904203 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:23.904348 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:24.005225 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:24.005397 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:24.193140 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:24.440353 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:24.440533 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:24.539228 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:24.539394 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:24.727870 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:24.967178 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:24.967332 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:25.069351 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:25.069626 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:25.254152 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:25.505282 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:25.505458 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:25.609855 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:25.610118 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:25.792215 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:26.035482 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:26.035482 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:26.134539 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:26.134833 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:26.356858 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:26.596205 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:26.596425 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:26.694492 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:26.694751 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:26.883676 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:27.125531 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:27.125837 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:27.225168 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:27.225350 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:27.417787 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:27.657167 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:27.657403 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:27.764051 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:27.764212 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:27.946251 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:28.187508 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:28.187639 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:28.287468 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:28.287703 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:28.474311 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:28.713622 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:28.713857 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:28.813087 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:28.813249 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:29.000373 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:29.244228 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:29.244483 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:29.344405 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:29.344593 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:29.527239 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:29.775011 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:29.775189 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:29.873744 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:29.873924 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:30.067612 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:30.309673 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:30.309922 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:30.411299 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:30.411509 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:30.593677 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:30.842834 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:30.843035 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:30.942739 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:30.942980 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:31.106701 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:31.351618 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:31.351760 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:31.451779 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:31.451905 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:31.631973 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:31.874237 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:31.874446 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:31.972151 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:31.972767 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:32.167024 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:32.433826 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:32.433971 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:32.535371 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:32.535596 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:32.729051 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:32.967184 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:32.967346 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:33.069398 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:33.069581 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:33.258088 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:33.503434 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:33.503609 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:33.606736 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:33.606959 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:33.695812 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:52:33.818491 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:52:33.818728 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:52:33.879853 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] backup MD5 for volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:52:33.880003 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:52:33.886694 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:52:33.892475 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:52:33.892703 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:52:33.897015 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:52:33.897168 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:52:33.900239 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:52:33.900509 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:52:33.951754 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:52:33.953594 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] _write_metadata started, container name: volumebackups, metadata filename: volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:52:33.977547 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "997dfc3a-50a3-42d1-9625-e5cca6eb2a5c",\n "backup_name": "tempest-type-Backup-1053773301",\n "created_at": "2026-07-05 03:52:20+00:00",\n "objects": [\n {\n "volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "7531b601-d561-420e-be44-7f77f76357e8",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"7531b601-d561-420e-be44-7f77f76357e8\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"b80b78941fd448ffbd4d016cc2facc64\\", \\"project_id\\": \\"9a2e18e6fd724ecabbdcdc1aed9f15d7\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:52:19.000000\\", \\"launched_at\\": \\"2026-07-05T03:52:19.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-312855528\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:52:19.000000\\", \\"updated_at\\": \\"2026-07-05T03:52:20.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:52:33.982916 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] backup 997dfc3a-50a3-42d1-9625-e5cca6eb2a5c finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:52:34.107261 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:52:34.126834 np0000004562 sudo[157834]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 05 03:52:34.127800 np0000004562 sudo[157834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:52:34.445601 np0000004562 sudo[157834]: pam_unix(sudo:session): session closed for user root Jul 05 03:52:34.448024 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.340s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:52:34.448905 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7531b601-d561-420e-be44-7f77f76357e8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7531b601-d561-420e-be44-7f77f76357e8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '3300000000e85a404', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:52:34.449161 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:52:34.449814 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:52:34.450354 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7531b601-d561-420e-be44-7f77f76357e8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7531b601-d561-420e-be44-7f77f76357e8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:52:34.461297 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:52:34.461297 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:52:34.461297 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:52:34.461297 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:52:34.461297 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:52:34.461297 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-7531b601-d561-420e-be44-7f77f76357e8 Jul 05 03:52:34.461297 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:52:34.461297 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:52:34.461297 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:52:34.461297 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:52:34.461297 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:52:34.461635 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:52:34.461635 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:52:34.461635 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:52:34.461873 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7531b601-d561-420e-be44-7f77f76357e8', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:52:34.483464 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('-m', 'session'): stdout=tcp: [241] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7531b601-d561-420e-be44-7f77f76357e8 (non-flash) Jul 05 03:52:34.483464 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:52:34.483667 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] iscsi session list stdout=tcp: [241] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7531b601-d561-420e-be44-7f77f76357e8 (non-flash) Jul 05 03:52:34.483667 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:52:34.483903 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7531b601-d561-420e-be44-7f77f76357e8', '241')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:52:34.484132 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7531b601-d561-420e-be44-7f77f76357e8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7531b601-d561-420e-be44-7f77f76357e8', '241')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:52:34.485291 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Resulting device map defaultdict(. at 0x72a46fd2b1a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7531b601-d561-420e-be44-7f77f76357e8'): ({'sdb'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:52:34.485599 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Removing single pathed devices sdb {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:52:34.498735 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Flushing IO for device /dev/sdb {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:52:34.508112 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:52:34.552378 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:52:34.552569 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:52:34.553330 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:52:34.563792 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:52:34.564122 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7531b601-d561-420e-be44-7f77f76357e8')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:52:34.576423 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:52:34.611829 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 241, target: iqn.2023-03.storpool.com:os--volume-7531b601-d561-420e-be44-7f77f76357e8, portal: 192.168.40.100,3260] Jul 05 03:52:34.611829 np0000004562 cinder-backup[101413]: Logout of [sid: 241, target: iqn.2023-03.storpool.com:os--volume-7531b601-d561-420e-be44-7f77f76357e8, portal: 192.168.40.100,3260] successful. Jul 05 03:52:34.611829 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:52:34.621914 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:52:34.622206 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.172s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:52:34.622393 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] <== disconnect_volume: return (173ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:52:35.644463 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-50aaca2d-0195-4637-923b-348585b609cb tempest-ProjectMemberTests33-1641103150 None] Create backup finished. backup: 997dfc3a-50a3-42d1-9625-e5cca6eb2a5c. Jul 05 03:52:38.398271 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Restore backup started, backup: eb4dc020-f37d-4f14-b95a-a0e142930233 volume: 5816a9d7-9811-4d05-8fb8-e461c236cff7. Jul 05 03:52:38.411415 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_9a2e18e6fd724ecabbdcdc1aed9f15d7 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:52:38.411835 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:52:38.412405 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:52:38.424529 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:52:38.445131 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:52:38.460380 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:52:38.460755 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:52:38.468654 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:52:38.469501 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544'] Jul 05 03:52:38.469661 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:52:38.469803 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:52:38.470066 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] <== get_connector_properties: return (57ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:52:39.476347 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:52:39.476850 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5816a9d7-9811-4d05-8fb8-e461c236cff7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5816a9d7-9811-4d05-8fb8-e461c236cff7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:52:39.477068 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:52:39.477671 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:52:39.477921 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5816a9d7-9811-4d05-8fb8-e461c236cff7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5816a9d7-9811-4d05-8fb8-e461c236cff7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:52:39.489356 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5816a9d7-9811-4d05-8fb8-e461c236cff7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:52:39.489827 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5816a9d7-9811-4d05-8fb8-e461c236cff7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:52:39.490040 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:52:39.499875 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:52:39.499875 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:52:39.510813 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5816a9d7-9811-4d05-8fb8-e461c236cff7] added Jul 05 03:52:39.510813 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:52:39.510813 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:52:39.510813 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:52:39.510813 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:52:39.510813 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:52:39.510813 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:52:39.511002 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:52:39.511377 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0212(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:52:39.511586 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:52:40.512310 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-5816a9d7-9811-4d05-8fb8-e461c236cff7 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:52:40.522831 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:52:40.532807 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:52:40.542172 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jul 05 03:52:40.542172 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:52:40.542297 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jul 05 03:52:40.542297 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:52:40.542443 np0000004562 cinder-backup[101413]: WARNING os_brick.initiator.connectors.iscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jul 05 03:52:40.542443 np0000004562 cinder-backup[101413]: Jul 05 03:52:40.567148 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5816a9d7-9811-4d05-8fb8-e461c236cff7, portal: 192.168.40.100,3260] Jul 05 03:52:40.567148 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5816a9d7-9811-4d05-8fb8-e461c236cff7, portal: 192.168.40.100,3260] successful. Jul 05 03:52:40.567148 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:52:40.576695 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:52:40.587370 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('-m', 'session'): stdout=tcp: [242] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5816a9d7-9811-4d05-8fb8-e461c236cff7 (non-flash) Jul 05 03:52:40.587370 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:52:40.587485 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] iscsi session list stdout=tcp: [242] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5816a9d7-9811-4d05-8fb8-e461c236cff7 (non-flash) Jul 05 03:52:40.587485 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:52:40.587823 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5816a9d7-9811-4d05-8fb8-e461c236cff7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.098s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:52:40.587945 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:52:40.588352 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] HCTL ('7', '-', '-', 0) found on session 242 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:52:40.588488 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:52:40.601022 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Searching for a device in session 242 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:52:40.601022 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5816a9d7-9811-4d05-8fb8-e461c236cff7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5816a9d7-9811-4d05-8fb8-e461c236cff7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:52:41.602028 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.124s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:52:41.602480 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] <== connect_volume: return (2125ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799275', 'path': '/dev/sdb'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:52:41.602591 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:52:41.619763 np0000004562 sudo[157957]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 05 03:52:41.620364 np0000004562 sudo[157957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:52:41.937098 np0000004562 sudo[157957]: pam_unix(sudo:session): session closed for user root Jul 05 03:52:41.939276 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.336s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:52:41.939816 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] starting restore of backup volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233 container: volumebackups, to new volume 5816a9d7-9811-4d05-8fb8-e461c236cff7, backup: eb4dc020-f37d-4f14-b95a-a0e142930233. {{(pid=101413) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jul 05 03:52:41.940012 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] _read_metadata started, container name: volumebackups, metadata filename: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233_metadata. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] _read_metadata finished. Metadata: { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "backup_description": null, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "backup_id": "eb4dc020-f37d-4f14-b95a-a0e142930233", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "backup_name": "tempest-type-Backup-1741087987", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "created_at": "2026-07-05 03:51:08+00:00", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "objects": [ Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00001": { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "offset": 0 Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00002": { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "offset": 52428800 Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00003": { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "offset": 104857600 Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00004": { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "offset": 157286400 Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00005": { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "offset": 209715200 Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00006": { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "offset": 262144000 Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00007": { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "offset": 314572800 Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00008": { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "offset": 367001600 Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00009": { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "offset": 419430400 Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00010": { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "offset": 471859200 Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00011": { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "offset": 524288000 Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00012": { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "offset": 576716800 Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00013": { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "offset": 629145600 Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00014": { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "offset": 681574400 Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00015": { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "offset": 734003200 Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00016": { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "offset": 786432000 Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00017": { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "offset": 838860800 Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00018": { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "offset": 891289600 Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00019": { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "offset": 943718400 Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00020": { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "offset": 996147200 Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00021": { Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "length": 25165824, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "offset": 1048576000 Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: ], Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "parent_id": null, Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "version": "1.0.0", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "volume_id": "ed2396ac-df7f-4fb8-b24b-b79d100c0a21", Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"ed2396ac-df7f-4fb8-b24b-b79d100c0a21\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"b80b78941fd448ffbd4d016cc2facc64\", \"project_id\": \"9a2e18e6fd724ecabbdcdc1aed9f15d7\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004562@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T03:51:07.000000\", \"launched_at\": \"2026-07-05T03:51:07.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumeV3RbacBaseTests-Volume-2027233181\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"ac464b70-f08d-447b-aa26-2823b4948fc2\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T03:51:06.000000\", \"updated_at\": \"2026-07-05T03:51:08.000000\"}}" Jul 05 03:52:41.956665 np0000004562 cinder-backup[101413]: }. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 03:52:41.960050 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Restoring backup version 1.0.0 {{(pid=101413) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jul 05 03:52:41.960050 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] _read_metadata started, container name: volumebackups, metadata filename: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233_metadata. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] _read_metadata finished. Metadata: { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "backup_description": null, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "backup_id": "eb4dc020-f37d-4f14-b95a-a0e142930233", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "backup_name": "tempest-type-Backup-1741087987", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "created_at": "2026-07-05 03:51:08+00:00", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "objects": [ Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00001": { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "offset": 0 Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00002": { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "offset": 52428800 Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00003": { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "offset": 104857600 Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00004": { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "offset": 157286400 Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00005": { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "offset": 209715200 Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00006": { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "offset": 262144000 Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00007": { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "offset": 314572800 Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00008": { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "offset": 367001600 Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00009": { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "offset": 419430400 Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00010": { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "offset": 471859200 Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00011": { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "offset": 524288000 Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00012": { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "offset": 576716800 Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00013": { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "offset": 629145600 Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00014": { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "offset": 681574400 Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00015": { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "offset": 734003200 Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00016": { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "offset": 786432000 Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00017": { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "offset": 838860800 Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00018": { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "offset": 891289600 Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00019": { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "offset": 943718400 Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00020": { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "length": 52428800, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "offset": 996147200 Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: }, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00021": { Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "compression": "zlib", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "length": 25165824, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "offset": 1048576000 Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: } Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: ], Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "parent_id": null, Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "version": "1.0.0", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "volume_id": "ed2396ac-df7f-4fb8-b24b-b79d100c0a21", Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"ed2396ac-df7f-4fb8-b24b-b79d100c0a21\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"b80b78941fd448ffbd4d016cc2facc64\", \"project_id\": \"9a2e18e6fd724ecabbdcdc1aed9f15d7\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004562@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T03:51:07.000000\", \"launched_at\": \"2026-07-05T03:51:07.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumeV3RbacBaseTests-Volume-2027233181\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"ac464b70-f08d-447b-aa26-2823b4948fc2\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T03:51:06.000000\", \"updated_at\": \"2026-07-05T03:51:08.000000\"}}" Jul 05 03:52:41.974641 np0000004562 cinder-backup[101413]: }. {{(pid=101413) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 03:52:41.977803 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] v1 volume backup restore of eb4dc020-f37d-4f14-b95a-a0e142930233 started. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 05 03:52:41.977803 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] metadata_object_names = ['volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00001', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00002', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00003', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00004', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00005', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00006', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00007', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00008', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00009', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00010', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00011', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00012', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00013', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00014', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00015', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00016', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00017', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00018', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00019', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00020', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00021']. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 05 03:52:42.014494 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] generated object list: ['volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00001', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00002', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00003', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00004', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00005', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00006', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00007', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00008', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00009', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00010', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00011', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00012', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00013', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00014', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00015', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00016', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00017', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00018', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00019', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00020', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00021', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233_metadata', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:52:42.051639 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:52:42.055826 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] restoring object. backup: eb4dc020-f37d-4f14-b95a-a0e142930233, container: volumebackups, object name: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00001, volume: 5816a9d7-9811-4d05-8fb8-e461c236cff7. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:52:42.069132 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:52:42.411528 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] restoring object. backup: eb4dc020-f37d-4f14-b95a-a0e142930233, container: volumebackups, object name: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00002, volume: 5816a9d7-9811-4d05-8fb8-e461c236cff7. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:52:42.425623 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:52:42.755339 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] restoring object. backup: eb4dc020-f37d-4f14-b95a-a0e142930233, container: volumebackups, object name: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00003, volume: 5816a9d7-9811-4d05-8fb8-e461c236cff7. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:52:42.773051 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:52:43.104736 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] restoring object. backup: eb4dc020-f37d-4f14-b95a-a0e142930233, container: volumebackups, object name: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00004, volume: 5816a9d7-9811-4d05-8fb8-e461c236cff7. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:52:43.118287 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:52:43.447432 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] restoring object. backup: eb4dc020-f37d-4f14-b95a-a0e142930233, container: volumebackups, object name: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00005, volume: 5816a9d7-9811-4d05-8fb8-e461c236cff7. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:52:43.460935 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:52:43.793732 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] restoring object. backup: eb4dc020-f37d-4f14-b95a-a0e142930233, container: volumebackups, object name: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00006, volume: 5816a9d7-9811-4d05-8fb8-e461c236cff7. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:52:43.807885 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:52:44.136352 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] restoring object. backup: eb4dc020-f37d-4f14-b95a-a0e142930233, container: volumebackups, object name: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00007, volume: 5816a9d7-9811-4d05-8fb8-e461c236cff7. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:52:44.150399 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:52:44.479525 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] restoring object. backup: eb4dc020-f37d-4f14-b95a-a0e142930233, container: volumebackups, object name: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00008, volume: 5816a9d7-9811-4d05-8fb8-e461c236cff7. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:52:44.492153 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:52:44.815600 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] restoring object. backup: eb4dc020-f37d-4f14-b95a-a0e142930233, container: volumebackups, object name: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00009, volume: 5816a9d7-9811-4d05-8fb8-e461c236cff7. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:52:44.829748 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:52:45.153595 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] restoring object. backup: eb4dc020-f37d-4f14-b95a-a0e142930233, container: volumebackups, object name: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00010, volume: 5816a9d7-9811-4d05-8fb8-e461c236cff7. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:52:45.166648 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:52:45.521459 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] restoring object. backup: eb4dc020-f37d-4f14-b95a-a0e142930233, container: volumebackups, object name: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00011, volume: 5816a9d7-9811-4d05-8fb8-e461c236cff7. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:52:45.534710 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:52:45.865700 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] restoring object. backup: eb4dc020-f37d-4f14-b95a-a0e142930233, container: volumebackups, object name: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00012, volume: 5816a9d7-9811-4d05-8fb8-e461c236cff7. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:52:45.880044 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:52:46.210899 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] restoring object. backup: eb4dc020-f37d-4f14-b95a-a0e142930233, container: volumebackups, object name: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00013, volume: 5816a9d7-9811-4d05-8fb8-e461c236cff7. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:52:46.228783 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:52:46.557975 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] restoring object. backup: eb4dc020-f37d-4f14-b95a-a0e142930233, container: volumebackups, object name: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00014, volume: 5816a9d7-9811-4d05-8fb8-e461c236cff7. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:52:46.571085 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:52:46.904358 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] restoring object. backup: eb4dc020-f37d-4f14-b95a-a0e142930233, container: volumebackups, object name: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00015, volume: 5816a9d7-9811-4d05-8fb8-e461c236cff7. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:52:46.918664 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:52:47.251226 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] restoring object. backup: eb4dc020-f37d-4f14-b95a-a0e142930233, container: volumebackups, object name: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00016, volume: 5816a9d7-9811-4d05-8fb8-e461c236cff7. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:52:47.266609 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:52:47.592171 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] restoring object. backup: eb4dc020-f37d-4f14-b95a-a0e142930233, container: volumebackups, object name: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00017, volume: 5816a9d7-9811-4d05-8fb8-e461c236cff7. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:52:47.606817 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:52:47.938479 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] restoring object. backup: eb4dc020-f37d-4f14-b95a-a0e142930233, container: volumebackups, object name: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00018, volume: 5816a9d7-9811-4d05-8fb8-e461c236cff7. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:52:47.952061 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:52:48.291779 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] restoring object. backup: eb4dc020-f37d-4f14-b95a-a0e142930233, container: volumebackups, object name: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00019, volume: 5816a9d7-9811-4d05-8fb8-e461c236cff7. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:52:48.304207 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:52:48.638488 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] restoring object. backup: eb4dc020-f37d-4f14-b95a-a0e142930233, container: volumebackups, object name: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00020, volume: 5816a9d7-9811-4d05-8fb8-e461c236cff7. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:52:48.652446 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:52:48.978292 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] restoring object. backup: eb4dc020-f37d-4f14-b95a-a0e142930233, container: volumebackups, object name: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00021, volume: 5816a9d7-9811-4d05-8fb8-e461c236cff7. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 03:52:48.993082 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] decompressing data using zlib algorithm {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 03:52:49.147727 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] v1 volume backup restore of eb4dc020-f37d-4f14-b95a-a0e142930233 finished. {{(pid=101413) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 05 03:52:49.147905 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Restoring volume base metadata {{(pid=101413) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 05 03:52:49.155552 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Excluding field 'display_name' {{(pid=101413) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 05 03:52:49.155808 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Excluding field 'display_description' {{(pid=101413) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 05 03:52:49.162038 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] No metadata of type 'volume-metadata' to restore {{(pid=101413) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 05 03:52:49.162225 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=101413) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 05 03:52:49.162413 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] restore eb4dc020-f37d-4f14-b95a-a0e142930233 to 5816a9d7-9811-4d05-8fb8-e461c236cff7 finished. {{(pid=101413) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jul 05 03:52:49.162910 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:52:49.182246 np0000004562 sudo[158241]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 05 03:52:49.183004 np0000004562 sudo[158241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:52:49.493418 np0000004562 sudo[158241]: pam_unix(sudo:session): session closed for user root Jul 05 03:52:49.495923 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.332s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:52:49.496773 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5816a9d7-9811-4d05-8fb8-e461c236cff7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5816a9d7-9811-4d05-8fb8-e461c236cff7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799275', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:52:49.497044 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:52:49.497785 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:52:49.498335 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5816a9d7-9811-4d05-8fb8-e461c236cff7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5816a9d7-9811-4d05-8fb8-e461c236cff7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:52:49.507851 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:52:49.507851 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:52:49.507851 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:52:49.507851 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:52:49.507851 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:52:49.507851 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-5816a9d7-9811-4d05-8fb8-e461c236cff7 Jul 05 03:52:49.507851 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:52:49.507851 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:52:49.507851 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:52:49.507851 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:52:49.507851 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:52:49.508121 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:52:49.508121 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:52:49.508121 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:52:49.508481 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5816a9d7-9811-4d05-8fb8-e461c236cff7', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:52:49.528381 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('-m', 'session'): stdout=tcp: [242] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5816a9d7-9811-4d05-8fb8-e461c236cff7 (non-flash) Jul 05 03:52:49.528381 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:52:49.528534 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] iscsi session list stdout=tcp: [242] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5816a9d7-9811-4d05-8fb8-e461c236cff7 (non-flash) Jul 05 03:52:49.528534 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:52:49.528703 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5816a9d7-9811-4d05-8fb8-e461c236cff7', '242')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:52:49.528897 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5816a9d7-9811-4d05-8fb8-e461c236cff7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5816a9d7-9811-4d05-8fb8-e461c236cff7', '242')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:52:49.529946 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Resulting device map defaultdict(. at 0x72a4705c0e00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5816a9d7-9811-4d05-8fb8-e461c236cff7'): ({'sdb'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:52:49.530217 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Removing single pathed devices sdb {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:52:49.540173 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Flushing IO for device /dev/sdb {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:52:49.547579 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:52:49.602101 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:52:49.602298 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:52:49.603066 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:52:49.614249 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:52:49.614541 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5816a9d7-9811-4d05-8fb8-e461c236cff7')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:52:49.625672 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:52:49.653284 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 242, target: iqn.2023-03.storpool.com:os--volume-5816a9d7-9811-4d05-8fb8-e461c236cff7, portal: 192.168.40.100,3260] Jul 05 03:52:49.653284 np0000004562 cinder-backup[101413]: Logout of [sid: 242, target: iqn.2023-03.storpool.com:os--volume-5816a9d7-9811-4d05-8fb8-e461c236cff7, portal: 192.168.40.100,3260] successful. Jul 05 03:52:49.653284 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:52:49.663822 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:52:49.664118 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.166s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:52:49.664188 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] <== disconnect_volume: return (167ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:52:50.677824 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.manager [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Encryption key ID for volume 5816a9d7-9811-4d05-8fb8-e461c236cff7 already matches encryption key ID in backup eb4dc020-f37d-4f14-b95a-a0e142930233. {{(pid=101413) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jul 05 03:52:50.696305 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-bc22f871-e363-413a-a17e-33056db537e6 tempest-ProjectMemberTests33-1641103150 None] Finished restoring backup eb4dc020-f37d-4f14-b95a-a0e142930233 to volume 5816a9d7-9811-4d05-8fb8-e461c236cff7. Jul 05 03:52:52.788079 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-d76bd66f-b643-4e8a-9c66-cd60a09a9bdf tempest-ProjectMemberTests33-1641103150 None] Delete backup started, backup: 997dfc3a-50a3-42d1-9625-e5cca6eb2a5c. Jul 05 03:52:52.796340 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-d76bd66f-b643-4e8a-9c66-cd60a09a9bdf tempest-ProjectMemberTests33-1641103150 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_9a2e18e6fd724ecabbdcdc1aed9f15d7 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:52:52.796340 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-d76bd66f-b643-4e8a-9c66-cd60a09a9bdf tempest-ProjectMemberTests33-1641103150 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:52:52.796340 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d76bd66f-b643-4e8a-9c66-cd60a09a9bdf tempest-ProjectMemberTests33-1641103150 None] delete started, backup: 997dfc3a-50a3-42d1-9625-e5cca6eb2a5c, container: volumebackups, prefix: volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:52:52.829240 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d76bd66f-b643-4e8a-9c66-cd60a09a9bdf tempest-ProjectMemberTests33-1641103150 None] generated object list: ['volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00001', 'volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00002', 'volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00003', 'volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00004', 'volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00005', 'volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00006', 'volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00007', 'volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00008', 'volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00009', 'volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00010', 'volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00011', 'volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00012', 'volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00013', 'volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00014', 'volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00015', 'volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00016', 'volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00017', 'volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00018', 'volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00019', 'volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00020', 'volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00021', 'volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c_metadata', 'volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:52:52.847580 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d76bd66f-b643-4e8a-9c66-cd60a09a9bdf tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00001 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:52.865471 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d76bd66f-b643-4e8a-9c66-cd60a09a9bdf tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00002 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:52.882890 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d76bd66f-b643-4e8a-9c66-cd60a09a9bdf tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00003 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:52.900203 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d76bd66f-b643-4e8a-9c66-cd60a09a9bdf tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00004 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:52.916286 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d76bd66f-b643-4e8a-9c66-cd60a09a9bdf tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00005 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:52.932599 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d76bd66f-b643-4e8a-9c66-cd60a09a9bdf tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00006 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:52.950433 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d76bd66f-b643-4e8a-9c66-cd60a09a9bdf tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00007 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:52.966830 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d76bd66f-b643-4e8a-9c66-cd60a09a9bdf tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00008 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:52.984032 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d76bd66f-b643-4e8a-9c66-cd60a09a9bdf tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00009 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:53.001841 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d76bd66f-b643-4e8a-9c66-cd60a09a9bdf tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00010 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:53.020877 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d76bd66f-b643-4e8a-9c66-cd60a09a9bdf tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00011 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:53.040087 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d76bd66f-b643-4e8a-9c66-cd60a09a9bdf tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00012 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:53.059218 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d76bd66f-b643-4e8a-9c66-cd60a09a9bdf tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00013 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:53.078268 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d76bd66f-b643-4e8a-9c66-cd60a09a9bdf tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00014 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:53.096230 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d76bd66f-b643-4e8a-9c66-cd60a09a9bdf tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00015 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:53.113376 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d76bd66f-b643-4e8a-9c66-cd60a09a9bdf tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00016 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:53.131358 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d76bd66f-b643-4e8a-9c66-cd60a09a9bdf tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00017 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:53.149609 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d76bd66f-b643-4e8a-9c66-cd60a09a9bdf tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00018 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:53.165346 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d76bd66f-b643-4e8a-9c66-cd60a09a9bdf tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00019 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:53.181351 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d76bd66f-b643-4e8a-9c66-cd60a09a9bdf tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00020 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:53.197238 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d76bd66f-b643-4e8a-9c66-cd60a09a9bdf tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c-00021 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:53.213108 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d76bd66f-b643-4e8a-9c66-cd60a09a9bdf tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c_metadata in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:53.228588 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d76bd66f-b643-4e8a-9c66-cd60a09a9bdf tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_7531b601-d561-420e-be44-7f77f76357e8/20260705035222/az_nova_backup_997dfc3a-50a3-42d1-9625-e5cca6eb2a5c_sha256file in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:53.228794 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-d76bd66f-b643-4e8a-9c66-cd60a09a9bdf tempest-ProjectMemberTests33-1641103150 None] delete 997dfc3a-50a3-42d1-9625-e5cca6eb2a5c finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:52:53.268786 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-d76bd66f-b643-4e8a-9c66-cd60a09a9bdf tempest-ProjectMemberTests33-1641103150 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:52:53.280799 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-d76bd66f-b643-4e8a-9c66-cd60a09a9bdf tempest-ProjectMemberTests33-1641103150 None] Created reservations ['4c537e38-0127-4b67-8e70-68cd002944e0', 'e11a30de-c9a6-48db-9367-79593bf0aa83'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:52:53.295878 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-d76bd66f-b643-4e8a-9c66-cd60a09a9bdf tempest-ProjectMemberTests33-1641103150 None] Delete backup finished, backup 997dfc3a-50a3-42d1-9625-e5cca6eb2a5c deleted. Jul 05 03:52:53.842811 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-57f60499-e98a-49fd-944a-17b8c86d94d9 tempest-ProjectMemberTests33-1641103150 None] Delete backup started, backup: ddc355a8-072b-43a2-b994-c648dc0b4864. Jul 05 03:52:53.846801 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-57f60499-e98a-49fd-944a-17b8c86d94d9 tempest-ProjectMemberTests33-1641103150 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_9a2e18e6fd724ecabbdcdc1aed9f15d7 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:52:53.847269 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-57f60499-e98a-49fd-944a-17b8c86d94d9 tempest-ProjectMemberTests33-1641103150 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:52:53.847838 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57f60499-e98a-49fd-944a-17b8c86d94d9 tempest-ProjectMemberTests33-1641103150 None] delete started, backup: ddc355a8-072b-43a2-b994-c648dc0b4864, container: volumebackups, prefix: volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:52:53.888265 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57f60499-e98a-49fd-944a-17b8c86d94d9 tempest-ProjectMemberTests33-1641103150 None] generated object list: ['volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00001', 'volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00002', 'volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00003', 'volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00004', 'volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00005', 'volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00006', 'volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00007', 'volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00008', 'volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00009', 'volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00010', 'volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00011', 'volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00012', 'volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00013', 'volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00014', 'volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00015', 'volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00016', 'volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00017', 'volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00018', 'volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00019', 'volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00020', 'volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00021', 'volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864_metadata', 'volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:52:53.906530 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57f60499-e98a-49fd-944a-17b8c86d94d9 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00001 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:53.924634 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57f60499-e98a-49fd-944a-17b8c86d94d9 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00002 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:53.941976 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57f60499-e98a-49fd-944a-17b8c86d94d9 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00003 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:53.958777 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57f60499-e98a-49fd-944a-17b8c86d94d9 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00004 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:53.977643 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57f60499-e98a-49fd-944a-17b8c86d94d9 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00005 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:53.993874 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57f60499-e98a-49fd-944a-17b8c86d94d9 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00006 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:54.010080 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57f60499-e98a-49fd-944a-17b8c86d94d9 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00007 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:54.027755 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57f60499-e98a-49fd-944a-17b8c86d94d9 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00008 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:54.045353 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57f60499-e98a-49fd-944a-17b8c86d94d9 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00009 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:54.063025 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57f60499-e98a-49fd-944a-17b8c86d94d9 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00010 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:54.083373 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57f60499-e98a-49fd-944a-17b8c86d94d9 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00011 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:54.101083 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57f60499-e98a-49fd-944a-17b8c86d94d9 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00012 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:54.117928 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57f60499-e98a-49fd-944a-17b8c86d94d9 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00013 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:54.141376 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57f60499-e98a-49fd-944a-17b8c86d94d9 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00014 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:54.162437 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57f60499-e98a-49fd-944a-17b8c86d94d9 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00015 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:54.182654 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57f60499-e98a-49fd-944a-17b8c86d94d9 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00016 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:54.201627 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57f60499-e98a-49fd-944a-17b8c86d94d9 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00017 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:54.221865 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57f60499-e98a-49fd-944a-17b8c86d94d9 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00018 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:54.241366 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57f60499-e98a-49fd-944a-17b8c86d94d9 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00019 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:54.259200 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57f60499-e98a-49fd-944a-17b8c86d94d9 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00020 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:54.281679 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57f60499-e98a-49fd-944a-17b8c86d94d9 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864-00021 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:54.302666 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57f60499-e98a-49fd-944a-17b8c86d94d9 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864_metadata in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:54.324863 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57f60499-e98a-49fd-944a-17b8c86d94d9 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_6ce2044a-33d2-4548-b48f-9ec9dcaa9560/20260705035203/az_nova_backup_ddc355a8-072b-43a2-b994-c648dc0b4864_sha256file in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:54.325118 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-57f60499-e98a-49fd-944a-17b8c86d94d9 tempest-ProjectMemberTests33-1641103150 None] delete ddc355a8-072b-43a2-b994-c648dc0b4864 finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:52:54.364884 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-57f60499-e98a-49fd-944a-17b8c86d94d9 tempest-ProjectMemberTests33-1641103150 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:52:54.378903 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-57f60499-e98a-49fd-944a-17b8c86d94d9 tempest-ProjectMemberTests33-1641103150 None] Created reservations ['648488aa-70e4-443e-93f5-89a9bd213590', 'd86f3428-3f3e-45ee-bf7c-f8547d7b5704'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:52:54.391673 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-57f60499-e98a-49fd-944a-17b8c86d94d9 tempest-ProjectMemberTests33-1641103150 None] Delete backup finished, backup ddc355a8-072b-43a2-b994-c648dc0b4864 deleted. Jul 05 03:52:54.897940 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-dd45534e-47bf-4d2f-8adb-382c3a01ec19 tempest-ProjectMemberTests33-1641103150 None] Delete backup started, backup: eb4dc020-f37d-4f14-b95a-a0e142930233. Jul 05 03:52:54.901332 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-dd45534e-47bf-4d2f-8adb-382c3a01ec19 tempest-ProjectMemberTests33-1641103150 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_9a2e18e6fd724ecabbdcdc1aed9f15d7 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:52:54.901945 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-dd45534e-47bf-4d2f-8adb-382c3a01ec19 tempest-ProjectMemberTests33-1641103150 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:52:54.902120 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-dd45534e-47bf-4d2f-8adb-382c3a01ec19 tempest-ProjectMemberTests33-1641103150 None] delete started, backup: eb4dc020-f37d-4f14-b95a-a0e142930233, container: volumebackups, prefix: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:52:54.939271 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-dd45534e-47bf-4d2f-8adb-382c3a01ec19 tempest-ProjectMemberTests33-1641103150 None] generated object list: ['volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00001', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00002', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00003', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00004', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00005', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00006', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00007', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00008', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00009', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00010', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00011', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00012', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00013', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00014', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00015', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00016', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00017', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00018', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00019', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00020', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00021', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233_metadata', 'volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:52:54.959005 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-dd45534e-47bf-4d2f-8adb-382c3a01ec19 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00001 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:54.976526 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-dd45534e-47bf-4d2f-8adb-382c3a01ec19 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00002 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:54.994459 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-dd45534e-47bf-4d2f-8adb-382c3a01ec19 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00003 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:55.011707 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-dd45534e-47bf-4d2f-8adb-382c3a01ec19 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00004 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:55.028293 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-dd45534e-47bf-4d2f-8adb-382c3a01ec19 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00005 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:55.044399 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-dd45534e-47bf-4d2f-8adb-382c3a01ec19 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00006 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:55.061159 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-dd45534e-47bf-4d2f-8adb-382c3a01ec19 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00007 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:55.077256 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-dd45534e-47bf-4d2f-8adb-382c3a01ec19 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00008 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:55.093164 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-dd45534e-47bf-4d2f-8adb-382c3a01ec19 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00009 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:55.109661 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-dd45534e-47bf-4d2f-8adb-382c3a01ec19 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00010 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:55.125872 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-dd45534e-47bf-4d2f-8adb-382c3a01ec19 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00011 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:55.141751 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-dd45534e-47bf-4d2f-8adb-382c3a01ec19 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00012 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:55.157746 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-dd45534e-47bf-4d2f-8adb-382c3a01ec19 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00013 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:55.173620 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-dd45534e-47bf-4d2f-8adb-382c3a01ec19 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00014 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:55.190457 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-dd45534e-47bf-4d2f-8adb-382c3a01ec19 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00015 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:55.207981 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-dd45534e-47bf-4d2f-8adb-382c3a01ec19 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00016 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:55.225815 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-dd45534e-47bf-4d2f-8adb-382c3a01ec19 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00017 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:55.242806 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-dd45534e-47bf-4d2f-8adb-382c3a01ec19 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00018 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:55.260913 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-dd45534e-47bf-4d2f-8adb-382c3a01ec19 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00019 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:55.279295 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-dd45534e-47bf-4d2f-8adb-382c3a01ec19 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00020 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:55.296422 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-dd45534e-47bf-4d2f-8adb-382c3a01ec19 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233-00021 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:55.314533 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-dd45534e-47bf-4d2f-8adb-382c3a01ec19 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233_metadata in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:55.332819 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-dd45534e-47bf-4d2f-8adb-382c3a01ec19 tempest-ProjectMemberTests33-1641103150 None] deleted object: volume_ed2396ac-df7f-4fb8-b24b-b79d100c0a21/20260705035110/az_nova_backup_eb4dc020-f37d-4f14-b95a-a0e142930233_sha256file in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:52:55.333032 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-dd45534e-47bf-4d2f-8adb-382c3a01ec19 tempest-ProjectMemberTests33-1641103150 None] delete eb4dc020-f37d-4f14-b95a-a0e142930233 finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:52:55.363733 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-dd45534e-47bf-4d2f-8adb-382c3a01ec19 tempest-ProjectMemberTests33-1641103150 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:52:55.375915 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-dd45534e-47bf-4d2f-8adb-382c3a01ec19 tempest-ProjectMemberTests33-1641103150 None] Created reservations ['02343288-9fc1-4120-ae40-b2e226a27ee0', '0282d46c-8657-49fb-bfc5-08ac8d1b3cbb'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:52:55.392387 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-dd45534e-47bf-4d2f-8adb-382c3a01ec19 tempest-ProjectMemberTests33-1641103150 None] Delete backup finished, backup eb4dc020-f37d-4f14-b95a-a0e142930233 deleted. Jul 05 03:52:59.963111 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Create backup started, backup: 7cb4195a-ecba-4b72-a95f-fee8c42e1ce8 volume: 10245d99-0dc5-4a41-a8d3-bb60331cca17. Jul 05 03:52:59.969139 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T03:52:59Z,data_timestamp=2026-07-05T03:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-1547996198',encryption_key_id=None,fail_reason=None,host='np0000004562',id=7cb4195a-ecba-4b72-a95f-fee8c42e1ce8,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='cb2caecfdeca4710a505e85058a1e344',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='bbcb0f27bcb84c1ea90f0aae686ef0c9',volume_id=10245d99-0dc5-4a41-a8d3-bb60331cca17) Jul 05 03:52:59.989311 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_cb2caecfdeca4710a505e85058a1e344 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:52:59.989728 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:52:59.990036 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:53:00.000305 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:53:00.022009 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:53:00.036956 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:53:00.037252 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:53:00.046126 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:53:00.046949 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544'] Jul 05 03:53:00.047078 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:53:00.047198 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:53:00.047417 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] <== get_connector_properties: return (56ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:53:00.551963 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:53:00.552377 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10245d99-0dc5-4a41-a8d3-bb60331cca17', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10245d99-0dc5-4a41-a8d3-bb60331cca17', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:53:00.552593 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:53:00.553116 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:53:00.553360 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10245d99-0dc5-4a41-a8d3-bb60331cca17', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10245d99-0dc5-4a41-a8d3-bb60331cca17', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:53:00.562883 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-10245d99-0dc5-4a41-a8d3-bb60331cca17" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:53:00.563326 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-10245d99-0dc5-4a41-a8d3-bb60331cca17" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:53:00.563595 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:53:00.573823 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:53:00.573823 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:53:00.584152 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-10245d99-0dc5-4a41-a8d3-bb60331cca17] added Jul 05 03:53:00.584152 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:53:00.584152 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:53:00.584152 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:53:00.584152 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:53:00.584152 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:53:00.584152 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:53:00.584467 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:53:00.584858 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0212(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:53:00.585033 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:53:01.586673 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-10245d99-0dc5-4a41-a8d3-bb60331cca17 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:53:01.596006 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:53:01.605631 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:53:01.614963 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jul 05 03:53:01.614963 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:53:01.615125 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jul 05 03:53:01.615125 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:53:01.615261 np0000004562 cinder-backup[101413]: WARNING os_brick.initiator.connectors.iscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jul 05 03:53:01.615261 np0000004562 cinder-backup[101413]: Jul 05 03:53:01.635905 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-10245d99-0dc5-4a41-a8d3-bb60331cca17, portal: 192.168.40.100,3260] Jul 05 03:53:01.635905 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-10245d99-0dc5-4a41-a8d3-bb60331cca17, portal: 192.168.40.100,3260] successful. Jul 05 03:53:01.635905 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:53:01.645570 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:53:01.654823 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] iscsiadm ('-m', 'session'): stdout=tcp: [247] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10245d99-0dc5-4a41-a8d3-bb60331cca17 (non-flash) Jul 05 03:53:01.654823 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:53:01.654992 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] iscsi session list stdout=tcp: [247] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10245d99-0dc5-4a41-a8d3-bb60331cca17 (non-flash) Jul 05 03:53:01.654992 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:53:01.655229 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-10245d99-0dc5-4a41-a8d3-bb60331cca17" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.092s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:53:01.655357 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:53:01.655804 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] HCTL ('7', '-', '-', 0) found on session 247 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:53:01.655930 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:53:01.667946 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Searching for a device in session 247 and hctl ['7', '*', '*', 0] yield: None {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:53:02.668830 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Searching for a device in session 247 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:53:02.669271 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10245d99-0dc5-4a41-a8d3-bb60331cca17', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10245d99-0dc5-4a41-a8d3-bb60331cca17', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:53:02.669596 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.116s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:53:02.669780 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] <== connect_volume: return (2117ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799282', 'path': '/dev/sdb'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:53:02.670072 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:53:02.687029 np0000004562 sudo[158597]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 05 03:53:02.687641 np0000004562 sudo[158597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:53:02.976876 np0000004562 sudo[158597]: pam_unix(sudo:session): session closed for user root Jul 05 03:53:02.978919 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.308s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:53:03.014936 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:53:03.021170 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] _create_container started, container: volumebackups,backup: 7cb4195a-ecba-4b72-a95f-fee8c42e1ce8. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:53:03.099831 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] generate_object_name_prefix: volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8 {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:53:03.104970 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] starting backup of volume: 10245d99-0dc5-4a41-a8d3-bb60331cca17, volume size: 1073741824, object names prefix volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:53:03.277223 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:03.521179 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:03.521379 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:03.623326 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] backup MD5 for volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:03.623659 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:03.801629 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:04.040668 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:04.040817 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:04.137475 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] backup MD5 for volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:04.137733 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:04.318459 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:04.555087 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:04.555207 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:04.655877 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] backup MD5 for volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:04.656038 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:04.837440 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:05.074901 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:05.075109 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:05.173069 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] backup MD5 for volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:05.173205 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:05.359779 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:05.596046 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:05.596159 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:05.695925 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] backup MD5 for volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:05.696088 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:05.895568 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:06.136812 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:06.136952 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:06.236165 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] backup MD5 for volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:06.236440 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:06.418999 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:06.660553 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:06.660675 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:06.765130 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] backup MD5 for volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:06.765284 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:06.944592 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:07.189163 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:07.189163 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:07.288512 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] backup MD5 for volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:07.288707 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:07.468014 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:07.710446 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:07.710662 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:07.810281 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] backup MD5 for volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:07.810531 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:08.003170 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:08.252731 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:08.252891 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:08.353823 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] backup MD5 for volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:08.354104 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:08.356111 np0000004562 cinder-backup[101413]: DEBUG dbcounter [-] [101413] Writing DB stats cinder:SELECT=113,cinder:UPDATE=33,cinder:INSERT=7 {{(pid=101413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:53:08.531799 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:08.785416 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:08.785532 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:08.883384 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] backup MD5 for volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:08.883674 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:09.064663 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:09.306797 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:09.307149 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:09.405992 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] backup MD5 for volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:09.406111 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:09.581012 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:09.822133 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:09.822288 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:09.925990 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] backup MD5 for volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:09.926222 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:10.122046 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:10.361204 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:10.361327 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:10.458950 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] backup MD5 for volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:10.459152 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:10.626387 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:10.868136 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:10.868323 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:10.967334 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] backup MD5 for volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:10.967499 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:11.154002 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:11.418363 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:11.418517 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:11.517020 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] backup MD5 for volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:11.517203 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:11.699464 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:11.801324 np0000004562 cinder-backup[101413]: DEBUG oslo_service.periodic_task [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:53:11.801478 np0000004562 cinder-backup[101413]: DEBUG cinder.manager [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Notifying Schedulers of capabilities ... {{(pid=101413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:53:11.940989 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:11.941138 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:12.040653 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] backup MD5 for volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:12.040828 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:12.250451 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:12.491151 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:12.491354 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:12.589624 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] backup MD5 for volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:12.589816 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:12.761002 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:13.005865 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:13.006009 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:13.108855 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] backup MD5 for volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:13.109068 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:13.304729 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:13.553489 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:13.553760 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:13.654105 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] backup MD5 for volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:13.654249 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:13.746137 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:13.863317 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:13.863459 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:13.920731 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] backup MD5 for volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:13.920904 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:13.927694 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:53:13.932495 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:53:13.932649 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:53:13.936412 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:53:13.936527 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:53:13.939131 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:53:13.939357 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:53:13.988068 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:53:13.988651 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] _write_metadata started, container name: volumebackups, metadata filename: volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:53:14.009709 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "7cb4195a-ecba-4b72-a95f-fee8c42e1ce8",\n "backup_name": "tempest-type-Backup-1547996198",\n "created_at": "2026-07-05 03:53:00+00:00",\n "objects": [\n {\n "volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "10245d99-0dc5-4a41-a8d3-bb60331cca17",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"10245d99-0dc5-4a41-a8d3-bb60331cca17\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"bbcb0f27bcb84c1ea90f0aae686ef0c9\\", \\"project_id\\": \\"cb2caecfdeca4710a505e85058a1e344\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:52:59.000000\\", \\"launched_at\\": \\"2026-07-05T03:52:59.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-341591964\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:52:59.000000\\", \\"updated_at\\": \\"2026-07-05T03:53:00.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:53:14.014250 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] backup 7cb4195a-ecba-4b72-a95f-fee8c42e1ce8 finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:53:14.133288 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:53:14.155090 np0000004562 sudo[158861]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 05 03:53:14.155928 np0000004562 sudo[158861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:53:14.457949 np0000004562 sudo[158861]: pam_unix(sudo:session): session closed for user root Jul 05 03:53:14.460221 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.327s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:53:14.460825 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10245d99-0dc5-4a41-a8d3-bb60331cca17', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10245d99-0dc5-4a41-a8d3-bb60331cca17', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799282', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:53:14.461005 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:53:14.461496 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:53:14.461889 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10245d99-0dc5-4a41-a8d3-bb60331cca17', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10245d99-0dc5-4a41-a8d3-bb60331cca17', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:53:14.473686 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:53:14.473686 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:53:14.473686 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:53:14.473686 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:53:14.473686 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:53:14.473686 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-10245d99-0dc5-4a41-a8d3-bb60331cca17 Jul 05 03:53:14.473686 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:53:14.473686 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:53:14.473686 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:53:14.473686 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:53:14.473686 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:53:14.474046 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:53:14.474046 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:53:14.474046 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:53:14.474258 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10245d99-0dc5-4a41-a8d3-bb60331cca17', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:53:14.494472 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] iscsiadm ('-m', 'session'): stdout=tcp: [247] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10245d99-0dc5-4a41-a8d3-bb60331cca17 (non-flash) Jul 05 03:53:14.494472 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:53:14.494742 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] iscsi session list stdout=tcp: [247] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10245d99-0dc5-4a41-a8d3-bb60331cca17 (non-flash) Jul 05 03:53:14.494742 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:53:14.494941 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10245d99-0dc5-4a41-a8d3-bb60331cca17', '247')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:53:14.495103 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-10245d99-0dc5-4a41-a8d3-bb60331cca17, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10245d99-0dc5-4a41-a8d3-bb60331cca17', '247')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:53:14.495890 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Resulting device map defaultdict(. at 0x72a47058cb80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10245d99-0dc5-4a41-a8d3-bb60331cca17'): ({'sdb'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:53:14.496093 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Removing single pathed devices sdb {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:53:14.508806 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Flushing IO for device /dev/sdb {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:53:14.517147 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:53:14.561500 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:53:14.561764 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:53:14.562633 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:53:14.574064 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:53:14.574406 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10245d99-0dc5-4a41-a8d3-bb60331cca17')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:53:14.584573 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:53:14.610673 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 247, target: iqn.2023-03.storpool.com:os--volume-10245d99-0dc5-4a41-a8d3-bb60331cca17, portal: 192.168.40.100,3260] Jul 05 03:53:14.610673 np0000004562 cinder-backup[101413]: Logout of [sid: 247, target: iqn.2023-03.storpool.com:os--volume-10245d99-0dc5-4a41-a8d3-bb60331cca17, portal: 192.168.40.100,3260] successful. Jul 05 03:53:14.610673 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:53:14.619543 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:53:14.619830 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.158s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:53:14.620012 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] <== disconnect_volume: return (159ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:53:15.640313 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-f7d5f592-41b1-40d2-998d-6b01651312dd tempest-ProjectMemberTests39-924104923 None] Create backup finished. backup: 7cb4195a-ecba-4b72-a95f-fee8c42e1ce8. Jul 05 03:53:16.380868 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-5ce23749-bf5e-4419-a6f9-1ae4c34c5d40 tempest-ProjectMemberTests39-924104923 None] Delete backup started, backup: 7cb4195a-ecba-4b72-a95f-fee8c42e1ce8. Jul 05 03:53:16.387980 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-5ce23749-bf5e-4419-a6f9-1ae4c34c5d40 tempest-ProjectMemberTests39-924104923 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_cb2caecfdeca4710a505e85058a1e344 {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:53:16.388181 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-5ce23749-bf5e-4419-a6f9-1ae4c34c5d40 tempest-ProjectMemberTests39-924104923 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:53:16.388381 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ce23749-bf5e-4419-a6f9-1ae4c34c5d40 tempest-ProjectMemberTests39-924104923 None] delete started, backup: 7cb4195a-ecba-4b72-a95f-fee8c42e1ce8, container: volumebackups, prefix: volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:53:16.426386 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ce23749-bf5e-4419-a6f9-1ae4c34c5d40 tempest-ProjectMemberTests39-924104923 None] generated object list: ['volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00001', 'volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00002', 'volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00003', 'volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00004', 'volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00005', 'volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00006', 'volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00007', 'volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00008', 'volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00009', 'volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00010', 'volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00011', 'volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00012', 'volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00013', 'volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00014', 'volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00015', 'volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00016', 'volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00017', 'volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00018', 'volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00019', 'volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00020', 'volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00021', 'volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8_metadata', 'volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:53:16.445786 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ce23749-bf5e-4419-a6f9-1ae4c34c5d40 tempest-ProjectMemberTests39-924104923 None] deleted object: volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00001 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:16.464141 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ce23749-bf5e-4419-a6f9-1ae4c34c5d40 tempest-ProjectMemberTests39-924104923 None] deleted object: volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00002 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:16.483774 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ce23749-bf5e-4419-a6f9-1ae4c34c5d40 tempest-ProjectMemberTests39-924104923 None] deleted object: volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00003 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:16.502548 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ce23749-bf5e-4419-a6f9-1ae4c34c5d40 tempest-ProjectMemberTests39-924104923 None] deleted object: volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00004 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:16.520649 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ce23749-bf5e-4419-a6f9-1ae4c34c5d40 tempest-ProjectMemberTests39-924104923 None] deleted object: volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00005 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:16.538521 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ce23749-bf5e-4419-a6f9-1ae4c34c5d40 tempest-ProjectMemberTests39-924104923 None] deleted object: volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00006 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:16.555170 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ce23749-bf5e-4419-a6f9-1ae4c34c5d40 tempest-ProjectMemberTests39-924104923 None] deleted object: volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00007 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:16.573331 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ce23749-bf5e-4419-a6f9-1ae4c34c5d40 tempest-ProjectMemberTests39-924104923 None] deleted object: volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00008 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:16.591166 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ce23749-bf5e-4419-a6f9-1ae4c34c5d40 tempest-ProjectMemberTests39-924104923 None] deleted object: volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00009 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:16.609778 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ce23749-bf5e-4419-a6f9-1ae4c34c5d40 tempest-ProjectMemberTests39-924104923 None] deleted object: volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00010 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:16.628782 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ce23749-bf5e-4419-a6f9-1ae4c34c5d40 tempest-ProjectMemberTests39-924104923 None] deleted object: volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00011 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:16.647699 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ce23749-bf5e-4419-a6f9-1ae4c34c5d40 tempest-ProjectMemberTests39-924104923 None] deleted object: volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00012 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:16.667387 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ce23749-bf5e-4419-a6f9-1ae4c34c5d40 tempest-ProjectMemberTests39-924104923 None] deleted object: volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00013 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:16.687836 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ce23749-bf5e-4419-a6f9-1ae4c34c5d40 tempest-ProjectMemberTests39-924104923 None] deleted object: volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00014 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:16.707050 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ce23749-bf5e-4419-a6f9-1ae4c34c5d40 tempest-ProjectMemberTests39-924104923 None] deleted object: volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00015 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:16.726512 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ce23749-bf5e-4419-a6f9-1ae4c34c5d40 tempest-ProjectMemberTests39-924104923 None] deleted object: volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00016 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:16.746073 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ce23749-bf5e-4419-a6f9-1ae4c34c5d40 tempest-ProjectMemberTests39-924104923 None] deleted object: volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00017 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:16.767999 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ce23749-bf5e-4419-a6f9-1ae4c34c5d40 tempest-ProjectMemberTests39-924104923 None] deleted object: volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00018 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:16.786735 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ce23749-bf5e-4419-a6f9-1ae4c34c5d40 tempest-ProjectMemberTests39-924104923 None] deleted object: volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00019 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:16.807857 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ce23749-bf5e-4419-a6f9-1ae4c34c5d40 tempest-ProjectMemberTests39-924104923 None] deleted object: volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00020 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:16.826951 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ce23749-bf5e-4419-a6f9-1ae4c34c5d40 tempest-ProjectMemberTests39-924104923 None] deleted object: volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8-00021 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:16.848540 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ce23749-bf5e-4419-a6f9-1ae4c34c5d40 tempest-ProjectMemberTests39-924104923 None] deleted object: volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8_metadata in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:16.869233 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ce23749-bf5e-4419-a6f9-1ae4c34c5d40 tempest-ProjectMemberTests39-924104923 None] deleted object: volume_10245d99-0dc5-4a41-a8d3-bb60331cca17/20260705035303/az_nova_backup_7cb4195a-ecba-4b72-a95f-fee8c42e1ce8_sha256file in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:16.869584 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-5ce23749-bf5e-4419-a6f9-1ae4c34c5d40 tempest-ProjectMemberTests39-924104923 None] delete 7cb4195a-ecba-4b72-a95f-fee8c42e1ce8 finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:53:16.906511 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-5ce23749-bf5e-4419-a6f9-1ae4c34c5d40 tempest-ProjectMemberTests39-924104923 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:53:16.921013 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-5ce23749-bf5e-4419-a6f9-1ae4c34c5d40 tempest-ProjectMemberTests39-924104923 None] Created reservations ['8cc73c51-1793-496f-84df-164b77d2a9d0', 'f8be3ae4-083e-4851-b7c5-6a1160648cb1'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:53:16.936148 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-5ce23749-bf5e-4419-a6f9-1ae4c34c5d40 tempest-ProjectMemberTests39-924104923 None] Delete backup finished, backup 7cb4195a-ecba-4b72-a95f-fee8c42e1ce8 deleted. Jul 05 03:53:26.934119 np0000004562 cinder-backup[101413]: DEBUG dbcounter [-] [101413] Writing DB stats cinder:SELECT=24,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=101413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:53:29.708765 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Create backup started, backup: 67dd7bec-2f5f-4401-8396-fe50f223e3aa volume: 621e94f9-ddf4-402a-a5ac-3ef0be6bc83b. Jul 05 03:53:29.713473 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T03:53:29Z,data_timestamp=2026-07-05T03:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-73271553',encryption_key_id=None,fail_reason=None,host='np0000004562',id=67dd7bec-2f5f-4401-8396-fe50f223e3aa,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='1f80303f3e9d41bda9bfff1ca2f99d3d',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='ee56b1a89b6b4d769d6653374635ed39',volume_id=621e94f9-ddf4-402a-a5ac-3ef0be6bc83b) Jul 05 03:53:29.735286 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_1f80303f3e9d41bda9bfff1ca2f99d3d {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:53:29.735758 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:53:29.736088 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.249', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:53:29.746199 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.scaleio [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101413) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 03:53:29.766114 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Running cmd (subprocess): nvme version {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:53:29.780217 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] 'nvme version' failed. Not Retrying. {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 03:53:29.780531 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] nvme not present on system {{(pid=101413) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 03:53:29.788539 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101413) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 03:53:29.789407 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.lightos [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Current host hostNQN and IP(s) are ['10.4.3.249', 'fe80::f816:3eff:fe96:5995', '192.168.40.6', 'fe80::f816:3eff:fe37:592d', '192.168.50.6', 'fe80::f816:3eff:fea3:511e', '192.168.10.6', 'fe80::f816:3eff:fec9:572b', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::44f6:6bff:feb0:e544'] Jul 05 03:53:29.789539 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 03:53:29.789662 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.lightos [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] LIGHTOS: no hostnqn found. {{(pid=101413) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 03:53:29.789919 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] <== get_connector_properties: return (53ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.249', 'host': 'np0000004562', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9a66145daf7b', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'de1635b4-ec41-49bb-8f98-49c84ee19729', 'nvme_native_multipath': False} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:53:30.293533 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connector [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Factory for iscsi on None {{(pid=101413) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 03:53:30.293923 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-621e94f9-ddf4-402a-a5ac-3ef0be6bc83b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '621e94f9-ddf4-402a-a5ac-3ef0be6bc83b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:53:30.294122 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:53:30.294653 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:53:30.294871 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-621e94f9-ddf4-402a-a5ac-3ef0be6bc83b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '621e94f9-ddf4-402a-a5ac-3ef0be6bc83b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 03:53:30.306449 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-621e94f9-ddf4-402a-a5ac-3ef0be6bc83b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:53:30.306915 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-621e94f9-ddf4-402a-a5ac-3ef0be6bc83b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:53:30.307177 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:53:30.319069 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 03:53:30.319069 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:53:30.331619 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-621e94f9-ddf4-402a-a5ac-3ef0be6bc83b] added Jul 05 03:53:30.331619 np0000004562 cinder-backup[101413]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 03:53:30.331619 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:53:30.331619 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:53:30.331619 np0000004562 cinder-backup[101413]: iscsiadm: Config file line 363 does not have value Jul 05 03:53:30.331619 np0000004562 cinder-backup[101413]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 03:53:30.331619 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:53:30.331977 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101413) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 03:53:30.332352 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.025(s), this was the 1st time calling it. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 03:53:30.332615 np0000004562 cinder-backup[101413]: DEBUG os_brick.utils [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101413) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 03:53:31.334183 np0000004562 cinder-backup[101413]: INFO os_brick.initiator.connectors.iscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.name = iqn.2023-03.storpool.com:os--volume-621e94f9-ddf4-402a-a5ac-3ef0be6bc83b Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.tpgt = -1 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.startup = manual Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.leading_login = No Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.iscsi_ifacename = default Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.net_ifacename = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.ipaddress = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.prefix_len = 0 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.hwaddress = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.transport_name = tcp Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.initiatorname = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.state = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.vlan_id = 0 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.vlan_priority = 0 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.vlan_state = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.iface_num = 0 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.mtu = 0 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.port = 0 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.bootproto = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.subnet_mask = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.gateway = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id_state = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.dhcp_alt_client_id = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.dhcp_dns = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.dhcp_learn_iqn = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.dhcp_req_vendor_id_state = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id_state = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.dhcp_vendor_id = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.dhcp_slp_da = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.fragmentation = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.gratuitous_arp = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.incoming_forwarding = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.tos_state = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.tos = 0 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.ttl = 0 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.delayed_ack = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.tcp_nagle = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.tcp_wsf_state = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.tcp_wsf = 0 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.tcp_timer_scale = 0 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.tcp_timestamp = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.redirect = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.def_task_mgmt_timeout = 0 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.header_digest = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.data_digest = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.immediate_data = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.initial_r2t = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.data_seq_inorder = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.data_pdu_inorder = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.erl = 0 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.max_receive_data_len = 0 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.first_burst_len = 0 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.max_outstanding_r2t = 0 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.max_burst_len = 0 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.chap_auth = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.bidi_chap = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.strict_login_compliance = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.discovery_auth = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: iface.discovery_logout = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.discovery_address = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.discovery_port = 0 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.discovery_type = fw Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.session.initial_cmdsn = 0 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.session.initial_login_retry_max = 8 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.session.xmit_thread_priority = 0 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.session.cmds_max = 128 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.session.queue_depth = 32 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.session.nr_sessions = 1 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.session.auth.authmethod = None Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.session.auth.username = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.session.auth.password = *** Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.session.auth.username_in = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.session.auth.password_in = Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.session.auth.chap_algs = SHA256 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.session.timeo.replacement_timeout = 120 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.session.err_timeo.abort_timeout = 15 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.session.iscsi.FastAbort = Yes Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.session.iscsi.InitialR2T = No Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.session.iscsi.ImmediateData = Yes Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxConnections = 1 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.session.iscsi.ERL = 0 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.session.scan = auto Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.session.reopen_max = 0 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.conn[0].address = 192.168.40.100 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.conn[0].port = 3260 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.conn[0].startup = manual Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.conn[0].tcp.window_size = 524288 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.conn[0].tcp.type_of_service = 0 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.conn[0].timeo.logout_timeout = 15 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.conn[0].timeo.login_timeout = 15 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.conn[0].timeo.auth_timeout = 45 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.HeaderDigest = None Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.DataDigest = None Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.IFMarker = No Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: node.conn[0].iscsi.OFMarker = No Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: # END RECORD Jul 05 03:53:31.343735 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:53:31.353287 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:53:31.362930 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jul 05 03:53:31.362930 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:53:31.363134 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jul 05 03:53:31.363134 np0000004562 cinder-backup[101413]: {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:53:31.363331 np0000004562 cinder-backup[101413]: WARNING os_brick.initiator.connectors.iscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jul 05 03:53:31.363331 np0000004562 cinder-backup[101413]: Jul 05 03:53:32.388901 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-621e94f9-ddf4-402a-a5ac-3ef0be6bc83b, portal: 192.168.40.100,3260] Jul 05 03:53:32.388901 np0000004562 cinder-backup[101413]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-621e94f9-ddf4-402a-a5ac-3ef0be6bc83b, portal: 192.168.40.100,3260] successful. Jul 05 03:53:32.388901 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:53:32.398573 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:53:32.407772 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] iscsiadm ('-m', 'session'): stdout=tcp: [250] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-621e94f9-ddf4-402a-a5ac-3ef0be6bc83b (non-flash) Jul 05 03:53:32.407772 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:53:32.407930 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] iscsi session list stdout=tcp: [250] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-621e94f9-ddf4-402a-a5ac-3ef0be6bc83b (non-flash) Jul 05 03:53:32.407930 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:53:32.408248 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-621e94f9-ddf4-402a-a5ac-3ef0be6bc83b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.101s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:53:32.408408 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Connected to 192.168.40.100:3260 {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 03:53:32.408875 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] HCTL ('7', '-', '-', 0) found on session 250 with lun 0 {{(pid=101413) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 03:53:32.409018 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101413) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 03:53:32.420992 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Searching for a device in session 250 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101413) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 03:53:32.420992 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-621e94f9-ddf4-402a-a5ac-3ef0be6bc83b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '621e94f9-ddf4-402a-a5ac-3ef0be6bc83b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101413) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 03:53:33.422592 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.128s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:53:33.423043 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] <== connect_volume: return (3129ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799296', 'path': '/dev/sdb'} {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:53:33.423173 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:53:33.440630 np0000004562 sudo[158967]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 05 03:53:33.441255 np0000004562 sudo[158967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:53:33.735129 np0000004562 sudo[158967]: pam_unix(sudo:session): session closed for user root Jul 05 03:53:33.737149 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.314s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:53:33.775682 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:53:33.781602 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] _create_container started, container: volumebackups,backup: 67dd7bec-2f5f-4401-8396-fe50f223e3aa. {{(pid=101413) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 03:53:33.955042 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] generate_object_name_prefix: volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa {{(pid=101413) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 03:53:33.960636 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] starting backup of volume: 621e94f9-ddf4-402a-a5ac-3ef0be6bc83b, volume size: 1073741824, object names prefix volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa, availability zone: nova {{(pid=101413) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 03:53:34.125533 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:34.366496 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:34.366604 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:34.467954 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] backup MD5 for volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:34.468379 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:34.650790 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:34.892550 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:34.892701 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:34.991596 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] backup MD5 for volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:34.991918 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:35.173430 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:35.415733 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:35.415948 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:35.512072 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] backup MD5 for volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:35.512531 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:35.691062 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:35.929630 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:35.929835 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:36.027901 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] backup MD5 for volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:36.028079 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:36.194101 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:36.430959 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:36.431099 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:36.527625 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] backup MD5 for volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:36.528088 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:36.699425 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:36.943095 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:36.943242 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:37.041460 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] backup MD5 for volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:37.041603 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:37.215036 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:37.458905 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:37.459012 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:37.556487 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] backup MD5 for volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:37.556937 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:37.732988 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:37.970834 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:37.970981 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:38.067604 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] backup MD5 for volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:38.067778 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:38.229638 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:38.466503 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:38.466660 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:38.564193 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] backup MD5 for volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:38.564760 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:38.737576 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:38.976756 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:38.976970 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:39.074570 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] backup MD5 for volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:39.074743 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:39.252844 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:39.500926 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:39.501048 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:39.599020 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] backup MD5 for volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:39.599518 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:39.773360 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:40.012477 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:40.012700 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:40.109886 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] backup MD5 for volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:40.110110 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:40.286365 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:40.531141 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:40.531303 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:40.627128 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] backup MD5 for volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:40.627691 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:40.799881 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:41.042739 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:41.042983 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:41.140252 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] backup MD5 for volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:41.140445 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:41.320702 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:41.562363 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:41.562560 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:41.660660 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] backup MD5 for volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:41.661088 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:41.846387 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:42.091983 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:42.092131 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:42.189778 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] backup MD5 for volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:42.189964 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:42.405936 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:42.647833 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:42.647944 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:42.745358 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] backup MD5 for volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:42.745808 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:42.922680 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:43.171098 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:43.171361 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:43.267150 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] backup MD5 for volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:43.267325 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:43.445932 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:43.690021 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:43.690215 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:43.788681 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] backup MD5 for volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:43.789178 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:43.979101 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:44.216363 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:44.216538 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:44.314070 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] backup MD5 for volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:44.314281 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:44.405149 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Backing up chunk of data from volume. {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 03:53:44.525964 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101413) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 03:53:44.526092 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] About to put_object {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 03:53:44.586596 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] backup MD5 for volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 03:53:44.586928 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Calling eventlet.sleep(0) {{(pid=101413) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 03:53:44.596154 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Getting metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 03:53:44.602161 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101413) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 03:53:44.602411 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Getting metadata type 'volume-metadata' {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 03:53:44.606387 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] No metadata type 'volume-metadata' available {{(pid=101413) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 03:53:44.606571 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Getting metadata type 'volume-glance-metadata' {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 03:53:44.609350 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.driver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] No metadata type 'volume-glance-metadata' available {{(pid=101413) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 03:53:44.609629 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa_sha256file. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 03:53:44.659865 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] _write_sha256file finished. {{(pid=101413) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 03:53:44.660511 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] _write_metadata started, container name: volumebackups, metadata filename: volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa_metadata. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 03:53:44.680527 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "67dd7bec-2f5f-4401-8396-fe50f223e3aa",\n "backup_name": "tempest-type-Backup-73271553",\n "created_at": "2026-07-05 03:53:30+00:00",\n "objects": [\n {\n "volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "621e94f9-ddf4-402a-a5ac-3ef0be6bc83b",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"621e94f9-ddf4-402a-a5ac-3ef0be6bc83b\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"ee56b1a89b6b4d769d6653374635ed39\\", \\"project_id\\": \\"1f80303f3e9d41bda9bfff1ca2f99d3d\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004562@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T03:53:29.000000\\", \\"launched_at\\": \\"2026-07-05T03:53:29.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1973643672\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"6a5dd9f9-cd12-4912-92fa-ac5efe4f585f\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"ac464b70-f08d-447b-aa26-2823b4948fc2\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T03:53:29.000000\\", \\"updated_at\\": \\"2026-07-05T03:53:30.000000\\"}}"\n}'. {{(pid=101413) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 03:53:44.685090 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] backup 67dd7bec-2f5f-4401-8396-fe50f223e3aa finished. {{(pid=101413) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 03:53:44.809208 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:53:44.827117 np0000004562 sudo[159031]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 05 03:53:44.827742 np0000004562 sudo[159031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 03:53:45.142586 np0000004562 sudo[159031]: pam_unix(sudo:session): session closed for user root Jul 05 03:53:45.144808 np0000004562 cinder-backup[101413]: DEBUG oslo_concurrency.processutils [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.335s {{(pid=101413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:53:45.145500 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-621e94f9-ddf4-402a-a5ac-3ef0be6bc83b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '621e94f9-ddf4-402a-a5ac-3ef0be6bc83b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799296', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 03:53:45.145720 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 03:53:45.146236 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 03:53:45.146639 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-621e94f9-ddf4-402a-a5ac-3ef0be6bc83b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '621e94f9-ddf4-402a-a5ac-3ef0be6bc83b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 03:53:45.157146 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 03:53:45.157146 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:53:45.157146 np0000004562 cinder-backup[101413]: iSNS: Jul 05 03:53:45.157146 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:53:45.157146 np0000004562 cinder-backup[101413]: STATIC: Jul 05 03:53:45.157146 np0000004562 cinder-backup[101413]: Target: iqn.2023-03.storpool.com:os--volume-621e94f9-ddf4-402a-a5ac-3ef0be6bc83b Jul 05 03:53:45.157146 np0000004562 cinder-backup[101413]: Portal: 192.168.40.100:3260,-1 Jul 05 03:53:45.157146 np0000004562 cinder-backup[101413]: Iface Name: default Jul 05 03:53:45.157146 np0000004562 cinder-backup[101413]: FIRMWARE: Jul 05 03:53:45.157146 np0000004562 cinder-backup[101413]: No targets found. Jul 05 03:53:45.157146 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:53:45.157635 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 03:53:45.157635 np0000004562 cinder-backup[101413]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 03:53:45.157635 np0000004562 cinder-backup[101413]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101413) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 03:53:45.157635 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-621e94f9-ddf4-402a-a5ac-3ef0be6bc83b', 0)] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 03:53:45.177104 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] iscsiadm ('-m', 'session'): stdout=tcp: [250] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-621e94f9-ddf4-402a-a5ac-3ef0be6bc83b (non-flash) Jul 05 03:53:45.177104 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 03:53:45.177278 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] iscsi session list stdout=tcp: [250] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-621e94f9-ddf4-402a-a5ac-3ef0be6bc83b (non-flash) Jul 05 03:53:45.177278 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 03:53:45.177509 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-621e94f9-ddf4-402a-a5ac-3ef0be6bc83b', '250')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 03:53:45.177670 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-621e94f9-ddf4-402a-a5ac-3ef0be6bc83b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-621e94f9-ddf4-402a-a5ac-3ef0be6bc83b', '250')] {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 03:53:45.178531 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Resulting device map defaultdict(. at 0x72a46fd123e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-621e94f9-ddf4-402a-a5ac-3ef0be6bc83b'): ({'sdb'}, set())}) {{(pid=101413) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 03:53:45.178772 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Removing single pathed devices sdb {{(pid=101413) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 03:53:45.189889 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Flushing IO for device /dev/sdb {{(pid=101413) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 03:53:45.197854 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101413) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 03:53:45.232271 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 03:53:45.232499 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] SCSI volumes sdb have been removed. {{(pid=101413) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 03:53:45.233373 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 03:53:45.245434 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.linuxscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101413) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 03:53:45.245789 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-621e94f9-ddf4-402a-a5ac-3ef0be6bc83b')] {{(pid=101413) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 03:53:45.256400 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:53:45.286584 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 250, target: iqn.2023-03.storpool.com:os--volume-621e94f9-ddf4-402a-a5ac-3ef0be6bc83b, portal: 192.168.40.100,3260] Jul 05 03:53:45.286584 np0000004562 cinder-backup[101413]: Logout of [sid: 250, target: iqn.2023-03.storpool.com:os--volume-621e94f9-ddf4-402a-a5ac-3ef0be6bc83b, portal: 192.168.40.100,3260] successful. Jul 05 03:53:45.286584 np0000004562 cinder-backup[101413]: stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:53:45.296743 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101413) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 03:53:45.297012 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.base [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.151s {{(pid=101413) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 03:53:45.297167 np0000004562 cinder-backup[101413]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] <== disconnect_volume: return (151ms) None {{(pid=101413) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 03:53:46.317242 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-12f37652-3a49-4562-8bf0-6ffd8b85ae68 tempest-ProjectReaderTests39-466392474 None] Create backup finished. backup: 67dd7bec-2f5f-4401-8396-fe50f223e3aa. Jul 05 03:53:47.043681 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-3be09f21-904c-4925-8c81-cf81138d63d8 tempest-ProjectReaderTests39-466392474 None] Delete backup started, backup: 67dd7bec-2f5f-4401-8396-fe50f223e3aa. Jul 05 03:53:47.050611 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-3be09f21-904c-4925-8c81-cf81138d63d8 tempest-ProjectReaderTests39-466392474 None] Using swift URL https://10.4.3.249:8080/v1/AUTH_1f80303f3e9d41bda9bfff1ca2f99d3d {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 03:53:47.050611 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.drivers.swift [None req-3be09f21-904c-4925-8c81-cf81138d63d8 tempest-ProjectReaderTests39-466392474 None] Connect to https://10.4.3.249:8080/v1/AUTH_ in "per_user" mode {{(pid=101413) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 03:53:47.050611 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3be09f21-904c-4925-8c81-cf81138d63d8 tempest-ProjectReaderTests39-466392474 None] delete started, backup: 67dd7bec-2f5f-4401-8396-fe50f223e3aa, container: volumebackups, prefix: volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 03:53:47.088902 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3be09f21-904c-4925-8c81-cf81138d63d8 tempest-ProjectReaderTests39-466392474 None] generated object list: ['volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00001', 'volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00002', 'volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00003', 'volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00004', 'volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00005', 'volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00006', 'volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00007', 'volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00008', 'volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00009', 'volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00010', 'volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00011', 'volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00012', 'volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00013', 'volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00014', 'volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00015', 'volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00016', 'volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00017', 'volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00018', 'volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00019', 'volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00020', 'volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00021', 'volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa_metadata', 'volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa_sha256file']. {{(pid=101413) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 03:53:47.107454 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3be09f21-904c-4925-8c81-cf81138d63d8 tempest-ProjectReaderTests39-466392474 None] deleted object: volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00001 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:47.124810 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3be09f21-904c-4925-8c81-cf81138d63d8 tempest-ProjectReaderTests39-466392474 None] deleted object: volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00002 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:47.142927 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3be09f21-904c-4925-8c81-cf81138d63d8 tempest-ProjectReaderTests39-466392474 None] deleted object: volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00003 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:47.160948 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3be09f21-904c-4925-8c81-cf81138d63d8 tempest-ProjectReaderTests39-466392474 None] deleted object: volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00004 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:47.177636 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3be09f21-904c-4925-8c81-cf81138d63d8 tempest-ProjectReaderTests39-466392474 None] deleted object: volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00005 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:47.196223 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3be09f21-904c-4925-8c81-cf81138d63d8 tempest-ProjectReaderTests39-466392474 None] deleted object: volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00006 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:47.214144 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3be09f21-904c-4925-8c81-cf81138d63d8 tempest-ProjectReaderTests39-466392474 None] deleted object: volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00007 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:47.230984 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3be09f21-904c-4925-8c81-cf81138d63d8 tempest-ProjectReaderTests39-466392474 None] deleted object: volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00008 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:47.248116 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3be09f21-904c-4925-8c81-cf81138d63d8 tempest-ProjectReaderTests39-466392474 None] deleted object: volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00009 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:47.266160 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3be09f21-904c-4925-8c81-cf81138d63d8 tempest-ProjectReaderTests39-466392474 None] deleted object: volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00010 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:47.284915 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3be09f21-904c-4925-8c81-cf81138d63d8 tempest-ProjectReaderTests39-466392474 None] deleted object: volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00011 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:47.303437 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3be09f21-904c-4925-8c81-cf81138d63d8 tempest-ProjectReaderTests39-466392474 None] deleted object: volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00012 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:47.320976 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3be09f21-904c-4925-8c81-cf81138d63d8 tempest-ProjectReaderTests39-466392474 None] deleted object: volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00013 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:47.339058 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3be09f21-904c-4925-8c81-cf81138d63d8 tempest-ProjectReaderTests39-466392474 None] deleted object: volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00014 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:47.357114 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3be09f21-904c-4925-8c81-cf81138d63d8 tempest-ProjectReaderTests39-466392474 None] deleted object: volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00015 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:47.376351 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3be09f21-904c-4925-8c81-cf81138d63d8 tempest-ProjectReaderTests39-466392474 None] deleted object: volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00016 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:47.396271 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3be09f21-904c-4925-8c81-cf81138d63d8 tempest-ProjectReaderTests39-466392474 None] deleted object: volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00017 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:47.414765 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3be09f21-904c-4925-8c81-cf81138d63d8 tempest-ProjectReaderTests39-466392474 None] deleted object: volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00018 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:47.434026 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3be09f21-904c-4925-8c81-cf81138d63d8 tempest-ProjectReaderTests39-466392474 None] deleted object: volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00019 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:47.454729 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3be09f21-904c-4925-8c81-cf81138d63d8 tempest-ProjectReaderTests39-466392474 None] deleted object: volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00020 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:47.473207 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3be09f21-904c-4925-8c81-cf81138d63d8 tempest-ProjectReaderTests39-466392474 None] deleted object: volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa-00021 in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:47.490423 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3be09f21-904c-4925-8c81-cf81138d63d8 tempest-ProjectReaderTests39-466392474 None] deleted object: volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa_metadata in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:47.508132 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3be09f21-904c-4925-8c81-cf81138d63d8 tempest-ProjectReaderTests39-466392474 None] deleted object: volume_621e94f9-ddf4-402a-a5ac-3ef0be6bc83b/20260705035333/az_nova_backup_67dd7bec-2f5f-4401-8396-fe50f223e3aa_sha256file in container: volumebackups. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 03:53:47.508416 np0000004562 cinder-backup[101413]: DEBUG cinder.backup.chunkeddriver [None req-3be09f21-904c-4925-8c81-cf81138d63d8 tempest-ProjectReaderTests39-466392474 None] delete 67dd7bec-2f5f-4401-8396-fe50f223e3aa finished. {{(pid=101413) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 03:53:47.540463 np0000004562 cinder-backup[101413]: DEBUG oslo_db.sqlalchemy.engines [None req-3be09f21-904c-4925-8c81-cf81138d63d8 tempest-ProjectReaderTests39-466392474 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 03:53:47.553123 np0000004562 cinder-backup[101413]: DEBUG cinder.quota [None req-3be09f21-904c-4925-8c81-cf81138d63d8 tempest-ProjectReaderTests39-466392474 None] Created reservations ['5ed51173-9116-4557-83a2-4ae81b398543', 'f5845f07-fcfc-4f39-8ded-56e788c2e991'] {{(pid=101413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:53:47.570390 np0000004562 cinder-backup[101413]: INFO cinder.backup.manager [None req-3be09f21-904c-4925-8c81-cf81138d63d8 tempest-ProjectReaderTests39-466392474 None] Delete backup finished, backup 67dd7bec-2f5f-4401-8396-fe50f223e3aa deleted. Jul 05 03:54:05.867276 np0000004562 cinder-backup[101413]: DEBUG dbcounter [-] [101413] Writing DB stats cinder:SELECT=39,cinder:UPDATE=13,cinder:INSERT=2 {{(pid=101413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:54:11.804758 np0000004562 cinder-backup[101413]: DEBUG oslo_service.periodic_task [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:54:11.805139 np0000004562 cinder-backup[101413]: DEBUG cinder.manager [None req-3f588dd9-7e66-479b-9ed6-a083ad8fe86e None None] Notifying Schedulers of capabilities ... {{(pid=101413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}